Easy-to-follow video tutorials help you learn software, creative, and business skills.Become a member

CameraTracker overview

From: Nuke 6.3 New Features

Video: CameraTracker overview

Nuke's 3D Camera Tracker is a powerful tool that allows you to do 3D matchmove shots with live-action clips. It reconstructs the original live-action camera move and generates a point cloud, 3D reference points located in the scene. You can then use that information to add 3D objects to the original scene. First, let's get an overview of the CameraTracker workflow. We'll start by getting a clip, so type R on the keyboard for Read node, select the Project Media folder.

CameraTracker overview

Nuke's 3D Camera Tracker is a powerful tool that allows you to do 3D matchmove shots with live-action clips. It reconstructs the original live-action camera move and generates a point cloud, 3D reference points located in the scene. You can then use that information to add 3D objects to the original scene. First, let's get an overview of the CameraTracker workflow. We'll start by getting a clip, so type R on the keyboard for Read node, select the Project Media folder.

Go to the Lesson_04_Media and select the camera tracking clip. And we'll open that and hook it up to the Viewer. Let's get a little more screen space here and I am going to type H on the keyboard to fit to the viewer. Now this is an idealized training clip that I created to have a successful and happy CameraTracking experience. Using the real live-action clip will introduce problems and difficulties and make the process a lot harder to learn. We'll stop this.

Now let's add the CameraTracker node, up to the 3D tab, select the CameraTracker node. Now the Camera Tracking process moves in three distinct steps. First is the Track Features. The program throws a whole bunch of 2D trackers on the screen and uses those to track 2D locations. Second, the Solve Camera step, this takes the 2D track information collected and then computes or reverse engineers, if you will, the live-action cameras location.

Three, Create Scene, this builds the point cloud and puts the 3D camera in so that you can now line up your 3D objects. So let's start by tracking our features. And it doesn't matter where the playhead is, because when you click Track Features, it jumps to the first frame in the clip. I am going to move the Progress bar down here so I can show you, I am going to lower the Gain just little bit, here are the 2D point trackers. The algorithm just throws a whole bunch of them all over the screen and they're used to track 2D targets in the scene, which becomes data for the Camera Solve.

And it's now tracking backward because the Nuke CameraTracker is a two-pass tracker. We are all done now and notice that we have orange colored points. Let's push in and take a look at one. As I scrub through the Timeline, you can see that it's showing you the path of that track. And the shorter the path, the slower it's moving and it also shows you the angle or the kind of motion, it's got a circular motion here, whereas these points up here are more straight.

Also, if you put your cursor on a point, it gives you the length of that track. That says that this point was actually tracked for a full 100 frames, this being a 100 frame clip, it did a fine job. Okay, I'm going to re-home the viewer with the H key and take a look at our next step, the Camera Solve. All we have to do is click the Solve Camera button and the CameraTracker analyzes all of those 2D tracking points to compute the camera's position. After the Camera Solve, the points have been colorized to sort them into different categories.

The green points are high quality or very reliable points, the red points are unreliable, and sometimes you'll see some yellow which are questionable. Notice as I zoom in to the same point, we now have some additional information. I put my cursor on that point. There is our original track length of 100, but now there is an Error of 0.74. Now watch what happens when I move the playhead one frame, and now the Error is 1.08, and another frame, Error is 1.07.

So that error number is showing you the tracking error for that point on this one frame. The next line, the RMS Error, is kind of an average of the tracking error over the whole length of the clip. And the third one, the Max Error is simply the largest error that it encounters during tracking. Okay, so let's re-home the viewer with an H and now go to step three, create the scene. Before I do that I want to move my Viewer node over here, because it tends to create a bunch of nodes and clobbers my viewer. So let's click Create Scene.

And now here's our new nodes, it's added the CameraTrackerPointCloud node, here is my camera, and of course the scene node just to tie it altogether. So let's switch to the 3D view, see what we got. Switch to 3D, zoom out a little bit; there is my point cloud, now if I play the clip, there is my Camera Solve. This is a 3D camera that duplicates the motion of the original live-action camera. Now personally I like to adjust the camera's uniform scale way down, so it doesn't have a silly huge camera in the shot.

Now let's take a look at our point cloud through the camera's viewfinder. Don't forget to turn on the Lock View button. So we can see the point cloud is now moving based on our moving camera, and yes that does look like our scene. We can see the wall over here with Marcy, there is our picture window and the little wooden box in the front, and these points out here are the points outside the window of the far mountains. Now we can do a confirmation of how good our camera solve and point cloud is by simply compositing the moving point cloud over the original clip.

Here is how we do that. Let's hook up the original Read node to input two of the viewer. Then, we'll set the viewer wipe controls to over, and we want the CameraTracker over the Read node and then switch the viewer to 3D. So you see, the CameraTracker, which is the point cloud, is over the Read node which is our background play. Move the wipe control off to the side so you can see the whole thing and you might want to adjust the viewer gain control for best visibility.

Now we can play the clip and confirm that the points seem to be locking to the scene. Of course, the points that represent the far distant mountains are cruising way in the background there and may look kind of funny. But all the points that are in the room appear to be locked to their targets, which is what we want. Now, this 3D grid can get in your way. If you want to get rid of it, click in the viewer, type S on the keyboard to get your viewer setup, select the 3D tab, and turn off the grid right here with this button.

And now you can watch your confirmation without any interference from the grid. When you are all done, don't forget to turn the 3D grid back on, there you go. Now that we have the big picture of how the CameraTracker works, let's back up and take a closer look at each step of the process.

Show transcript

This video is part of

Image for Nuke 6.3 New Features
Nuke 6.3 New Features

52 video lessons · 2311 viewers

Steve Wright
Author

 
Expand all | Collapse all
  1. 2m 10s
    1. Welcome
      1m 50s
    2. Using the exercise files
      20s
  2. 9m 0s
    1. Building the mesh
      4m 12s
    2. Projecting images on the mesh
      4m 48s
  3. 26m 6s
    1. Exploring basic setup
      6m 21s
    2. Using camera track points
      10m 5s
    3. Understanding how to do a corner pin
      9m 40s
  4. 7m 22s
    1. Demoing the PointsTo3D node
      45s
    2. Using the PointsTo3D node
      6m 37s
  5. 15m 28s
    1. Setting the locators
      5m 4s
    2. Keyframing the locators
      2m 30s
    3. Doing the camera solve
      5m 34s
    4. Creating 3D cards
      2m 20s
  6. 5m 27s
    1. Working with the GeoSelect node
      5m 27s
  7. 8m 58s
    1. Understanding the Displacement node
      5m 19s
    2. Working with the ScanLineRender settings
      3m 39s
  8. 8m 49s
    1. Using the AudioRead node
      8m 49s
  9. 7m 44s
    1. Deep compositing briefing
      7m 44s
  10. 32m 55s
    1. CameraTracker overview
      7m 3s
    2. Tracking the scene
      4m 48s
    3. Solving the camera
      5m 28s
    4. Building the 3D scene
      6m 48s
    5. Adding 3D geometry
      8m 48s
  11. 9m 18s
    1. Tracking the scene
      4m 52s
    2. Filtering the point cloud
      4m 26s
  12. 19m 59s
    1. Analyzing the image
      8m 5s
    2. Exploring three workflows
      7m 18s
    3. Using the STMap node
      4m 36s
  13. 19m 41s
    1. Modeling new 3D geometry
      6m 46s
    2. Lining up 3D objects
      3m 16s
    3. Building the whole set
      7m 4s
    4. Exporting Modeler geometry
      2m 35s
  14. 1h 0m
    1. Exploring the PlanarTracker workflow
      6m 47s
    2. Correcting tracking drift
      2m 40s
    3. Coping with tracking occlusions
      6m 30s
    4. Tracking with multiple shapes
      6m 34s
    5. Tracking out-of-frame targets
      5m 32s
    6. Placing the planar surface out of frame
      4m 35s
    7. Exporting: corner pin (relative)
      4m 24s
    8. Exporting: Tracker node
      4m 24s
    9. Exporting: corner pin (stabilize)
      5m 15s
    10. Adding a roto shape to a track layer
      3m 42s
    11. Adding multiple roto shapes to a track layer
      3m 24s
    12. Using the mask input
      6m 40s
  15. 46m 20s
    1. Using the ParticleEmitter node
      4m 26s
    2. Creating particles
      4m 42s
    3. Adding emitters
      5m 59s
    4. Adding forces
      8m 18s
    5. Bouncing particles
      5m 28s
    6. Changing particle appearance
      7m 21s
    7. Adding streaks
      5m 42s
    8. Setting streak attributes
      4m 24s

Start learning today

Get unlimited access to all courses for just $25/month.

Become a member
Sometimes @lynda teaches me how to use a program and sometimes Lynda.com changes my life forever. @JosefShutter
@lynda lynda.com is an absolute life saver when it comes to learning todays software. Definitely recommend it! #higherlearning @Michael_Caraway
@lynda The best thing online! Your database of courses is great! To the mark and very helpful. Thanks! @ru22more
Got to create something yesterday I never thought I could do. #thanks @lynda @Ngventurella
I really do love @lynda as a learning platform. Never stop learning and developing, it’s probably our greatest gift as a species! @soundslikedavid
@lynda just subscribed to lynda.com all I can say its brilliant join now trust me @ButchSamurai
@lynda is an awesome resource. The membership is priceless if you take advantage of it. @diabetic_techie
One of the best decision I made this year. Buy a 1yr subscription to @lynda @cybercaptive
guys lynda.com (@lynda) is the best. So far I’ve learned Java, principles of OO programming, and now learning about MS project @lucasmitchell
Signed back up to @lynda dot com. I’ve missed it!! Proper geeking out right now! #timetolearn #geek @JayGodbold
Share a link to this course

What are exercise files?

Exercise files are the same files the author uses in the course. Save time by downloading the author's files instead of setting up your own files, and learn by following along with the instructor.

Can I take this course without the exercise files?

Yes! If you decide you would like the exercise files later, you can upgrade to a premium account any time.

Become a member Download sample files See plans and pricing

Please wait... please wait ...
Upgrade to get access to exercise files.

Exercise files video

How to use exercise files.

Learn by watching, listening, and doing, Exercise files are the same files the author uses in the course, so you can download them and follow along Premium memberships include access to all exercise files in the library.


Exercise files

Exercise files video

How to use exercise files.

For additional information on downloading and using exercise files, watch our instructional video or read the instructions in the FAQ .

This course includes free exercise files, so you can practice while you watch the course. To access all the exercise files in our library, become a Premium Member.

Join now Already a member? Log in

Are you sure you want to mark all the videos in this course as unwatched?

This will not affect your course history, your reports, or your certificates of completion for this course.


Mark all as unwatched Cancel

Congratulations

You have completed Nuke 6.3 New Features.

Return to your organization's learning portal to continue training, or close this page.


OK
Become a member to add this course to a playlist

Join today and get unlimited access to the entire library of video courses—and create as many playlists as you like.

Get started

Already a member ?

Become a member to like this course.

Join today and get unlimited access to the entire library of video courses.

Get started

Already a member?

Exercise files

Learn by watching, listening, and doing! Exercise files are the same files the author uses in the course, so you can download them and follow along. Exercise files are available with all Premium memberships. Learn more

Get started

Already a Premium member?

Exercise files video

How to use exercise files.

Ask a question

Thanks for contacting us.
You’ll hear from our Customer Service team within 24 hours.

Please enter the text shown below:

The classic layout automatically defaults to the latest Flash Player.

To choose a different player, hold the cursor over your name at the top right of any lynda.com page and choose Site preferences from the dropdown menu.

Continue to classic layout Stay on new layout
Exercise files

Access exercise files from a button right under the course name.

Mark videos as unwatched

Remove icons showing you already watched videos if you want to start over.

Control your viewing experience

Make the video wide, narrow, full-screen, or pop the player out of the page into its own window.

Interactive transcripts

Click on text in the transcript to jump to that spot in the video. As the video plays, the relevant spot in the transcript will be highlighted.

Thanks for signing up.

We’ll send you a confirmation email shortly.


Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

Keep up with news, tips, and latest courses with emails from lynda.com.

Sign up and receive emails about lynda.com and our online training library:

Here’s our privacy policy with more details about how we handle your information.

   
submit Lightbox submit clicked
Terms and conditions of use

We've updated our terms and conditions (now called terms of service).Go
Review and accept our updated terms of service.