Seasonal Savings: 20% off selected memberships for a limited time. Give now

Easy-to-follow video tutorials help you learn software, creative, and business skills.Become a member

Automatically lip-syncing to audio

From: 2D Character Animation with After Effects

Video: Automatically lip-syncing to audio

Now, there's an easy way to lip-sync animation using time remapping and the convert audio keyframe assistant. If you want to follow along with this, open time remapping project from the animating using time remapping folder, and open up O6A talking dog start. Now what I have here is a couple of seconds of a dog talking. (music playing) And some audio in the background. (music playing) Now the audio is from a friend of mine, Jason Levines, so thank you Jason Levine for providing that music. What I've done with the music is, I've stripped out the musical instruments from the audio, and I've done that using a center channel extract tool, in an old copy of Edition that I had. (music playing) >> I don't need to know your Business.

Automatically lip-syncing to audio

Now, there's an easy way to lip-sync animation using time remapping and the convert audio keyframe assistant. If you want to follow along with this, open time remapping project from the animating using time remapping folder, and open up O6A talking dog start. Now what I have here is a couple of seconds of a dog talking. (music playing) And some audio in the background. (music playing) Now the audio is from a friend of mine, Jason Levines, so thank you Jason Levine for providing that music. What I've done with the music is, I've stripped out the musical instruments from the audio, and I've done that using a center channel extract tool, in an old copy of Edition that I had. (music playing) >> I don't need to know your Business.

>> So you'll see that the vocals go on for a long time, but the clip is only a few seconds long, In fact, the animatable bit of it is only really, how long, two seconds. Now, my idea was that if I move time backwards and forwards, It kind of looks like the dog's talking. So, it's just opening and closing the mouth by moving time backwards and forwards, and if I do it while I'm talking, it kind of looks like the dog's saying what I'm saying. Okay, so that was my idea. So, I applied time remapping to the layer, and of course, that creates two keyframes, a beginning keyframe and an end keyframe. And it also allows me to stretch the layer out, for the whole duration of the comp, which is what I did.

Now if I pull the keyframe to the end, we now stretch that animation to last (music playing) for the whole duration of the comp. So we've (music playing) basically just slowed down the animation (music playing) Now, what I want to do is I want to get the audio levels, which I'm going to reveal by double hitting the L key, to control the time remap value. So again, I'm going to go to Animation, Keyframe assistant, Convert audio to keyframes. I'm going to open the keyframes by hitting the U key on the keyboard, and then deleting the left channel and right channel effects, so that I'm only using the both channels effect. I'm going to Alt Click on the stopwatch for time remapping, and drag the Pic Quip over to the slider value, so that we're taking the time remap value from the slider value.

And we can tell that's happening, cause if we read the expression it's saying, take the time remap value of this layer from this comp, which means this composition, Layer Audio Amplitude, which is the audio amplitude layer, Affect Both Channels, both channels, slider value, slider value. So, that's all it's doing, it's taking the value from there. Now if we preview that, you'll see something's happeningSOUND that's not quite right. >> (music playing). To know your. >> And that's because the range of values is wrong. So what we're going to do is we're going to use the ease expression to take 1 range of values, and convert them to another.

So I'm going to say a equals that value. So a now becomes a variable to represent this value, and I'm going to add a semicolon at the end, and add a new line to the expression. And I'm going to type in and I'm going to type in Ease, as in ease in and ease out. Then I'm going to open parentheses, and I need to enter values now, but I don't know what the values are yet. So I'm going to disable the expression and use my old technique of selecting the keyframes in the graph editor, and going to the Info palette to find out what my minimum and maximum values are.

So, what I need to put in here, is 0 and 15. They're my minimum and maximum values, currently. So, first of all, I put the letter a to represent my current value, which at the moment is at 12. Then I'm going to say what my minimum and maximum value in the range is, and at the moment it's between 0 and 15. And then I'm going to say well, I want to take keyframes between, say 0 and 1 second, because remember his mouth only opened and closed between 0 and 2 seconds.

So I think 0 and 1 second is probably going to be enough. And that will sample frames from the first one second of the talking dog animation, which means that when I set a value of 15 it will put the time remap value to one second to round about there. When the values at zero, it will go back to zero, so in fact your just opening and closing his mouth in time with the audio settings. And if we have a quick preview of that, we should see him talking. >> I don't need, to know your business. I'm not interested in you, bringing me down.

(CROSSTALK) And we could have him singing for as long as we want, using that technique. We've only have to render a few frames of 3D animation and we have him singing for ever. Okay, now if I open the O6B talking dog end, I've actually switched on the instruments again and I've also added some other things to the mix. I've done a bit of smoothing on the expression, so I've just refined the expression a little bit and decided that I only needed to take values between 7 and 13 and go between 0 and 0.9. Now I did that just through trial and error, really. And if we have a look at the keyframes, I'll smooth them out by making them continuous Bezier keyframes.

And we'll just preview that before we finish. (MUSICMUSIC) >> I don't need, to know your, business, I'm not interested, in you, bringing me down. Okay, now, the other thing that I've added there, is frame blending. And frame blending, if you watch as we preview it, it gives us that nice little blended effect, as the mouth is opening and closing. (music playing) It kind of looks like a bit of a realistic Motion blur (music playing) >> I don't need, to know your business, I'm not, interested, in you, bringing me down, do I, wouldn't I, phone booth, mean't for talking da da da da da.

>> So, thank you for that wonderful performance Jason Levine, and thank you Mr talking dog. So, timely mapping allows you to do lots of clever little techniques. So, just try practicing and playing with timely mapping, and I'm sure you'll come up with some of your own unique techniques too.

Show transcript

This video is part of

Image for 2D Character Animation with After Effects
2D Character Animation with After Effects

27 video lessons · 3323 viewers

Angie Taylor
Author

 

Start learning today

Get unlimited access to all courses for just $25/month.

Become a member
Sometimes @lynda teaches me how to use a program and sometimes Lynda.com changes my life forever. @JosefShutter
@lynda lynda.com is an absolute life saver when it comes to learning todays software. Definitely recommend it! #higherlearning @Michael_Caraway
@lynda The best thing online! Your database of courses is great! To the mark and very helpful. Thanks! @ru22more
Got to create something yesterday I never thought I could do. #thanks @lynda @Ngventurella
I really do love @lynda as a learning platform. Never stop learning and developing, it’s probably our greatest gift as a species! @soundslikedavid
@lynda just subscribed to lynda.com all I can say its brilliant join now trust me @ButchSamurai
@lynda is an awesome resource. The membership is priceless if you take advantage of it. @diabetic_techie
One of the best decision I made this year. Buy a 1yr subscription to @lynda @cybercaptive
guys lynda.com (@lynda) is the best. So far I’ve learned Java, principles of OO programming, and now learning about MS project @lucasmitchell
Signed back up to @lynda dot com. I’ve missed it!! Proper geeking out right now! #timetolearn #geek @JayGodbold
Share a link to this course

What are exercise files?

Exercise files are the same files the author uses in the course. Save time by downloading the author's files instead of setting up your own files, and learn by following along with the instructor.

Can I take this course without the exercise files?

Yes! If you decide you would like the exercise files later, you can upgrade to a premium account any time.

Become a member Download sample files See plans and pricing

Please wait... please wait ...
Upgrade to get access to exercise files.

Exercise files video

How to use exercise files.

Learn by watching, listening, and doing, Exercise files are the same files the author uses in the course, so you can download them and follow along Premium memberships include access to all exercise files in the library.


Exercise files

Exercise files video

How to use exercise files.

For additional information on downloading and using exercise files, watch our instructional video or read the instructions in the FAQ .

This course includes free exercise files, so you can practice while you watch the course. To access all the exercise files in our library, become a Premium Member.

Join now Already a member? Log in

Are you sure you want to mark all the videos in this course as unwatched?

This will not affect your course history, your reports, or your certificates of completion for this course.


Mark all as unwatched Cancel

Congratulations

You have completed 2D Character Animation with After Effects.

Return to your organization's learning portal to continue training, or close this page.


OK
Become a member to add this course to a playlist

Join today and get unlimited access to the entire library of video courses—and create as many playlists as you like.

Get started

Already a member ?

Become a member to like this course.

Join today and get unlimited access to the entire library of video courses.

Get started

Already a member?

Exercise files

Learn by watching, listening, and doing! Exercise files are the same files the author uses in the course, so you can download them and follow along. Exercise files are available with all Premium memberships. Learn more

Get started

Already a Premium member?

Exercise files video

How to use exercise files.

Ask a question

Thanks for contacting us.
You’ll hear from our Customer Service team within 24 hours.

Please enter the text shown below:

The classic layout automatically defaults to the latest Flash Player.

To choose a different player, hold the cursor over your name at the top right of any lynda.com page and choose Site preferences from the dropdown menu.

Continue to classic layout Stay on new layout
Exercise files

Access exercise files from a button right under the course name.

Mark videos as unwatched

Remove icons showing you already watched videos if you want to start over.

Control your viewing experience

Make the video wide, narrow, full-screen, or pop the player out of the page into its own window.

Interactive transcripts

Click on text in the transcript to jump to that spot in the video. As the video plays, the relevant spot in the transcript will be highlighted.

Learn more, save more. Upgrade today!

Get our Annual Premium Membership at our best savings yet.

Upgrade to our Annual Premium Membership today and get even more value from your lynda.com subscription:

“In a way, I feel like you are rooting for me. Like you are really invested in my experience, and want me to get as much out of these courses as possible this is the best place to start on your journey to learning new material.”— Nadine H.

Thanks for signing up.

We’ll send you a confirmation email shortly.


Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

Keep up with news, tips, and latest courses with emails from lynda.com.

Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

   
submit Lightbox submit clicked
Terms and conditions of use

We've updated our terms and conditions (now called terms of service).Go
Review and accept our updated terms of service.