-
- user interface:
- demo video: Auto Lip-Sync in 1 minute
- installation video: Installation in 2 minutes
- price: $39.99
With Auto Lip-Sync you can create a mouth that automatically animates according to your voice recording.
Demo Video
Features
Automatic Animation: Fully automatic movement of the mouth - no need for keyframes
Step by Step Wizard: The step by step wizard guides you though the process.
Mouth Interior Animation: Optional animation of teeth and tongue - fully automatic and easy to adjust.
Fine Tuning: Easy and quick fine-tuning on top of the automatic animation: Control with convenient slider controls how wide the mouth opens and how it deforms, adjust the shape of the opened or closed mouth and set markers at points where you feel the mouth should have more of an O-shape.
Related tutorials
Talking Tree with Auto Lip-Sync
- Duration: 26:02
- Tools: After Effects and Auto Lip-Sync
- Languages:
Talking Car using Auto Lip-Sync
- Duration: 38:15
- Tools: After Effects, Auto Lip-Sync, mocha and MochaImport+
- Languages:
Quick Tip: Talking Chipmunk
- Duration: 9:53
- Tools: After Effects and Auto Lip-Sync
- Languages:
Auto Lip-Sync: How to replace the audio after creating the mouth rig
- Duration: 4:22
- Tools: After Effects and Auto Lip-Sync
- Languages:
Examples
"Froggy Girl" by Eric D. Kirk, winner of the Auto Lip-Sync contest
300 Mashed Potatoes, re-enactment of a scene from 300.
Speechless by Senzagiridiparole (won second prize in Auto Lip-Sync contest).
A Bagels Life by Aaron Waller (won third prize in Auto Lip-Sync contest).
The user interface
Update
To update Auto Lip-Sync, download the most current trial version here. Your old installation can simply be replaced. Your installed license is automatically detected and does not need to be entered again.
Comments
Error at line 1 of ||:
After Effects error: The std::string is too long, it can only be 31 bytes after conversion.
It also doesn't load the UI panel into window in after effects. I have to use File/scripts and choose the AutoLipSync.jsxbin. I don't have the Scripts UI Panels folder so I created it, is that a possible reason why it causes an error?
If you have any information on how to fix it I would be extremely grateful.
sorry to hear you have this problem. I think I know what the issue is. I'll prepare a fix and send it to you.
Best
Mathias
The fix worked great! I really appreciate the help and once again this is a great tool.
will you please tell me the fix for CS3 as well, i really want to use it, Thanks :)
the current version 1.01 on aescripts.com already contains this fix. You can download it via the TRY button here:
aescripts.com/auto-lip-sync/
Best,
Mathias
for Auto Lip-Sync it does not matter whether its a person, a tree or a car. If you have some video with a person that is saying nothing and you can track his face, you can do it exactly as in the talking car tutorial.
Best,
Mathias
I guess you try to use a movie clip that your version of mocha does not support. Try to convert it into a tiff image sequence or if you are on Mac OS into a ProRes QuickTime mov file.
launching it via MochaImport+. On this first startup, Mocha does
some configurations and asks for your preferences.....
what does it mean , kindly explain it. thanks alot
what exactly is your problem? What do you mean with mocha shows no tracking data? You need to track in mocha and then export the tracking data.
Best,
Mathias
Is it possible to reduce amount of key frames in Voice Volume layer? (Except manual way) Plug-in creates a nice work but it reacats a bit too sensitively. Now it creates a key frame in almost every frame. I would like to do every frame for example in every 5 frames.
the best way to achieve this is to use the Smoother which is build into AE. See "Smooth motion and velocity by removing extra keyframes" here:
help.adobe.com/.../...
between steps 4 and 5, the O-Shape-Deformation effect is created. This one is the most compute-intensive part of the entire rig, but its unusual, that it slows the rig down so much. I guess it depends on the size of your composition and the area covered by the different masks. I would also try to disable multiprocessing in the AE prefs to see whether this makes any difference.
I would suggest to temporarily disable to O-Shape Deformation effect while working. If you don't use markers to fine-tune the mouth movement, you can even keep this effect disabled for the final render.
Also, how do you scrub the audio ? I can't scrub the audio like you did to find the O sound. I'm using AE CS5.5.
yes, the manual shaping of the open mouth uses some advanced expressions that are only available in CS6. However, setting the markers and controlling the o-shape deformation with the masks still works with older versions.
For scrubbing, see: helpx.adobe.com/.../...
- To scrub audio in the Timeline panel, Ctrl+Alt-drag (Windows) or Command+Option-drag (Mac OS) the current-time indicator.
- To scrub audio and video in the Timeline panel, Ctrl-drag (Windows) or Command-drag (Mac OS) the current-time indicator.
And thank you for helping me find how to scrub audio,..
I'm trying to use Auto Lip-Sync on an object with an already open mouth, specifically an electrical outlet.
Any ideas on making the script work with this model?
Thanks much,
~ Jordan
Auto Lip-Sync cannot deform the interior of the mouth if that is what you want to have.
What you can do is to prepare a clean place in photoshop where the "open mouth is closed", i.e. the electrical outlet is removed. Then you can reinsert the original image or video behind it, such that when the mouth opens, the outlet is revealed behind it as mouth interior (but not deformed).
Cheers,
Mathias
Thanks for creating a great plug-in!
Can you tell me if it's possible to make the tool less sensitive to every sound?
I realise this is a strange request but the amount of mouth movement I'm getting (with a clean, studio-recorded voice-over) looks over-the-top in the situation I'm using it in.
It seems to replicate every word (great in most situations) but I'd really like to reproduce a simple, phoneme-based look, if at all possible? 'Voice Volume' seems to only affect the size of the mouth opening at any given point in the audio.
Can you give me any help on achieving this look or would modifying the audio track be the simplest solution? Thanks, Ben.
you are correct that "Voice Volume" controls how much the mouth opens. Maybe you get the desired look, if you manipulate it manually or with expressions?
You could try to to modify Voice Volume with one of the following techniques:
- apply the Basic Smoother iExpression to it to get a less detailed movement (you can also use the smooth expression from my tutorial "Stabilize motion without the need to zoom")
- apply a Snap 2 Grid iExpression to it to replace the continuous movement by a few discrete steps. A grid size of 20 means, for example, that voice volume is rounded to 0,20%,40%,60%,80%,100%
- apply an expression like "value < 20 ? 0:value"
to set all volume below 20% to complete silence (mouth closed).
- delete keyframes in the regions where you don't want the mouth to move at all
you can keep everything in one comp.
Simply run Auto Lip-Sync twice on two separate layers. Before running it the first time, make sure that only the audio for the first voice is audible and every other audio is disabled. Before running it the second time, just disable audio of the first voice and enable audio for the second one.
Cheers,
Mathias
Followed the installation instructions to the letter but Auto Lip Sync does not appear under the Window tab.
I have set the preferences as required.
I am using CS3 under Windows 8.
I think in CS3 you have to create the folder "ScriptUI Panels", as it does not exist automatically. The exact location will be something like
C:\Program Files\Adobe\Ado be After Effects CS3\Support Files\Scripts\S criptUI Panels
If it still does not work, you can also run Auto Lip Sync using the AE menu command file->scripts->run script file.
See here for details:
aescripts.com/.../...
Cheers,
Mathias
I got it working via the AE menu command but when I run it, it gives me an error after straightening the mouth:
AE error: Can not add a property with name "CC Split 2" to this PropertyGroup.
I am animating a 107 Kb photo with a 12Kb .wav file over a 5 second period.
I have a modern laptop with 8Gb RAM.
Cheers,
Mathias
www.cycorefx.com/products.php
RSS feed for comments to this post