The Best examples of 'Deepfake'-style AI facial replacement ever seen created using ZAO app

Virtual reality, augmented reality, and other forms of video immersion—collectively known as extended reality or "XR" ( #ZAO is a Chinese app which completely blew up since Friday. Best application of 'Deepfake'-style AI facial replacement I've ever seen.

Here's an example of me as DiCaprio (generated in under 8 secs from that one photo in the thumbnail) 🤯
It's already under a lot of fire for user privacy protection under their terms and conditions. So consider this my sacrifice to demonstrate so you don't have to give up your portrait identity rights 😅
It’s clear that #ZAO isn’t really going for "accuracy" per se, but rather a "subjective" good looking result. Similar to a beauty cam, it retains facial structure of the original actors, so the cherry picked results more or less always looks good and encourages users to share.
I can totally see this being applied in Films/ TV, imagine logging into your Netflix or Disney+ account - watching the latest TV show/ Marvel movie, where a stand-in actor's would be auto-replaced with your own.

The newest member of the Avengers is....YOU.
The #ZAO app even has a built in meme gif generator...Apple is way behind the curve with Memoji’s 😅
Before this gets too sensational - just to clarify: #ZAO app generates these vids from a preselected cherry-picked clips. I'm assuming they've trained an A.I. on SAID clips for generic targeting of facial features and quickly retargeting your facial features from a single photo.
It's not able to magically recompose anyone's face on any video immediately. In fact, it's not doing anything that existing platforms that allow users to post selfies can't already (or potentially) do. As cynical as I am about dangers of AI, let's not get too conspiratorial here.
Actually since this app went viral in China, the biggest focus over the past few days has been in regards to its user privacy terms - with many social media (ie. Wechat) blocking #ZAO vids from being shared and users requesting the app to delete their account/ photos.
So no, the Chinese government isn't trying to take over the world by hijacking your facial likeness through #ZAO, considering:

A. The app is only available in Chinese app stores and there's pretty much already security cams in every street corner in Chinese cities.
B. For such foul-play it's much easier to crawl existing social media for people's selfies rather than spending all this effort to build a commercial app that only requests 'one photo' from users as a selling point.
There's a lot skepticism in the comments, but I'm calling it now: #KPOP fans will push #Zao to the top of trending and download charts in the near future once their idols are added 🤭
Oh yeah, #Zao also works rather well with CG characters. I guess folks might not have to spend hours during character creation? I can see streamers loving this application of AI facial replacement. #DMC5
According to #Zao devs, the app burnt through 1/3 of the bandwidth of their 7 Million RMB/m (4.4m USD/month) server on the first evening. There's currently a long waiting queue for account registrations. #AI #Deepfake
A new special notice in the updated terms states #Zao will only use uploaded facial data for partial image replacement, data will be stored on servers according to relevant copyright laws. No further usage/ changes to app function unless with user's renewed permission.
For those curious about how protection of identity works in #Zao, the app verifies against a database of 'public figures' when you upload a photo. Apparently it's quite a badge of honour for some folks to be rejected by the system because they were mistaken for a 'celebrity'.
If you upload a photo vs taking a selfie, #Zao requires a second check via front facing camera to verify identity. It remains to be seen how well this system works, the running joke is that the app will be taken down as soon as someone fools the system with a photo of #XiJinping.
A video upload function exists in #Zao, but users need to be verified first to access. I have not able to get this to work. It seems like the same group of "users" uploading all the vids. I suspect this is how Zao is getting around the copyright issue.
This is truly the next evolution of #memes and we're entering uncharted territory. People might be cool with sharing memes of others, or flattered to be made into a meme, but what happens when it's millions of other faces on your body? #ZAO #DeepFakes
A new line probably needs to be drawn when it comes to "Transformative work" and I'd imagine new clauses will be drawn up in actor's contracts since #Zao's success sets an clear example the advertising industry will not be able to ignore. Next #Avengers movie trailer anyone?

ZAO,Deepfake,AI,XR,XRFiles,