Disney Develops Face Swapping Technology That Could Change How Movies Are Made

Face swapping technology has been seen in recent years in Disney films with varying levels of success. However, a project coming out of the Disney Research Studios is poised to completely change that. While the technology has advanced through the years, it is about to go to a whole new level thanks to Disney’s neural face-swapping technology.

This technology addresses several of the challenges in creating these deepfake videos as they are known. One of them is creating a massive database of a person. This needs to be a look at every angle of every expression of a person. The larger the database, the better the quality can be for creating accurate face swaps. Unfortunately, quite often the source images aren’t able to get this much data. So, to make a truly accurate and convincing face swap video is getting high-quality origin data. If it is high enough quality, it can be used for film production.

Disney has created a new algorithm that can do just that. From the source images/video, it can first stabilize and smooth out the original target. This is to make it easier for swapping faces later in the process. Then the process of blending the new face with the original face begins. This is quite complicated but basically the algorithm works to create a smooth and blended compilation between the original face and the new one so it looks natural.

Here is a demo video that Disney Research Studios posted on how this process works:

We propose an algorithm for fully automatic neural face swapping in images and videos. To the best of our knowledge, this is the first method capable of rendering photo-realistic and temporally coherent results at megapixel resolution. To this end, we introduce a progressively trained multi-way comb network and a light- and contrast-preserving blending method. We also show that while progressive training enables generation of high-resolution images, extending the architecture and training data beyond two people allows us to achieve higher fidelity in generated expressions. When compositing the generated expression onto the target face, we show how to adapt the blending strategy to preserve contrast and low-frequency lighting. Finally, we incorporate a refinement strategy into the face landmark stabilization algorithm to achieve temporal stability, which is crucial for working with high-resolution videos. We conduct an extensive ablation study to show the influence of our design choices on the quality of the swap and compare our work with popular state-of-the-art methods.

The potential for this technology really is limitless as it continues to get more and more believable. However, the potential may not be the way one originally imagined. Yes, it could be used for face swaps between an actor and their stunt double. It could also help avoid reshoots with moments that didn’t go quite as expected. As the technology continues to improve this will become more and more the norm. It will also become a way to save money on production. One other thing it will do? It will make it much harder to recognize when these deepfakes are used. If things go as Disney Research Studios hope, soon the fake could be indistinguishable from the real thing!

What do you think about this deepfake/face swapping technology? Share your thoughts in the comments below or with DAPS MAGIC on Facebook or Twitter!

Book your next Disney trip through DAPS MAGIC’s travel partner Mouseways Travel! Let Mouseways focus on the details so you can focus on enjoying the magic! Book your next Disney trip at
MOUSEWAYS.COM/DAPSMAGIC today! 

Share on facebook
Facebook
Share on twitter
Twitter
Share on pinterest
Pinterest

Share your thoughts and comment!

Mr. DAPs

Mr. DAPs

Hi, I'm Mr. DAPs, the Founder, and Editor in Chief of DAPS MAGIC! I can be regularly found at Disneyland with my hat and bow tie taking pictures and simply enjoying the Happiest Place on Earth. I'm also the weekly host of GEEKS CORNER and your Disney reporter for DISNEY REPORTER on DAPS MAGIC's YouTube channel. I am also now honored to announced that I'm a Brand Ambassador with Her Universe! Find me on Twitter and Instagram. as I'd love to connect with you. Make sure and say hi!

SUBSCRIBE TO DAPS MAGIC TODAY!

DAPS MAGIC YOUTUBE

MOUSEWAYS TRAVEL

GEEKS CORNER PODCAST

POPULAR POSTS

Top Posts & Pages
New Walt Disney World 50th Anniversary Starbucks ‘Been There’ Mugs Arrive at Disney’s Animal Kingdom and Disney’s Hollywood Studios
Zombie Captain America From What If...? Added to Oogie Boogie Bash
Disney Legend Ruthie Tompson Dies at 111
The History of the Candlelight Ceremony at Disneyland
9 Spooky Disney Animated Shorts Perfect for Halloween Time
Knott's Scary Farm is Back in 2021 with New Mazes, Scare Zones, and Shows!
Free Guy - Mr. DAPs Home Entertainment Review
Medals for runDisney's 2022 Disney Princess Half Marathon Weekend Revealed