The demo was originally freely accessible, but you now have to register to use it. The paper in question describing their method (called Wav2Lip) was posted a few weeks ago, along with a public demo for anyone to try. What they are is dumb and fun - two qualities I value highly when committing to waste my time write an informative and engaging article for my employer.Īs James Kelleher, the Irish designer who created the Queen deepfake, noted on Twitter, the method he used to make the videos was shared online by some AI researchers. (Who needs deepfakes for that when normal editing does the job just as well?) They’re not even that convincing, at least not without some extra time and effort. Now, these video aren’t nefarious deepfakes designed to undermine democracy and bring about the infopocalypse. Pintman Paddy Losty X Donald Trump /cxftc5zit0- James Kelleher SeptemFinding the algorithms (You can tell I don’t have much of a technical background, right?) The end result is videos like this one of the queen singing Queen:
Automatic lip sync adobe animate code#
Mash those two things together using code and, hey presto, you have a deepfake. All you need is a video of your subject and an audio clip you want them to follow.
The basic mechanism is tantalizingly simple. But when I saw an apparently straightforward method for creating quick lip-sync deepfakes in no time at all, I knew I had to try it for myself. But what does it take to turn random code you found online into a genuine deepfake? I can now say from personal experience, you really need just two things: time and patience.ĭespite writing about deepfakes for years, I’ve only ever made them using prepackaged apps that did the work for me.
You can even now do basic face-swaps in a handful of apps. (Though, that might not be possible for you if you're dealing with massive amounts of movements in a short amount of time) If you're struggling to animate lips, it always helps to look in the mirror and repeat the dialog with very exaggerated mouth movements to get a feel for how it looks.Īfter doing some poking around, there is this interesting program, MocapX, which will mirror your facial movements into a Maya scene, but it's a pay-for plug-in and you need an iPhone X, 11, or iPad Pro.How easy is it to make a deepfake, really? Over the past few years, there’s been a steady stream of new methods and algorithms that deliver more and more convincing AI-generated fakes. If it's possible for you to animate it, even simply, I think that'll give a much nicer look. Some do this better than others, and some will try and mimic the shape based on the sounds, but I don't think you can get smooth natural-looking lip movements from automatic systems - it's almost always heavily animated or motion-captured (or a combination of the two)
All the auto lipsyncs that I've seen always just take the audio and open the mouth more the louder the sound is, making the jaw just flap open up and down. I don't know of any programs for Maya so I might be wrong, but in my experience, that's just a matter of automatic lipsyncing.
0 kommentar(er)
