Author
Released
2/21/2017This course focuses on using interactive hardware controllers to drive real-time 3D scenes in TouchDesigner and Unreal Engine. In TouchDesigner, look at a MIDI controller with sliders that you can use to drive the creation of effects in a real-time rendering system. Next, learn about using TouchOSC to build a custom UI that you can transfer to an iPad that sends OSC messages to TouchDesigner. Then, learn how to use those messages to move particles and objects around on screen. To wrap up, learn how to get data off of a Kinect sensor into TouchDesigner so you can control that same particle and object movement. The course also covers MIDI, OSC, and Kinect as they apply to Unreal Engine.
- Using TouchOSC to build a custom UI
- Transferring a custom UI to an iPad
- Controlling objects with OSC
- Setting up Kinect
- Getting data off of a Kinect sensor and into TouchDesigner
- Using OSC messages to move particles and objects around
- Installing VS and downloading the plug-in
- Creating a C++ Unreal project and compiling a plugin
- Installing the Kinect 4 Unreal plugin
Skill Level Intermediate
Duration
Views
- [Instructor] In this course we're going to learn how to use interactive hardware controllers to drive real-time 3D scenes, in both TouchDesigner and Unreal Engine. We'll start off in TouchDesigner where we'll look at a MIDI controller with sliders that we'll use to drive an effects system that we're going to have create effects after a real-time rendering system. Then we're going to move on to OSC, where we're going to use TouchOSC to be able to build a custom UI that we transfer to an iPad, that sends OSC messages that TouchDesigner can receive. Then we'll learn how to use those messages to move particles and objects around on screen.
Then we'll wrap up our touch section with looking at how to get data off a Kinect sensor in a TouchDesigner to be able to control that same particle and object movement. Then we'll switch over to Unreal Engine, we'll start off with MIDI and we'll look at how we build a blueprint in Unreal Engine, to get MIDI flowing into our system. And then we're going to show you how we can build a post process material that's controlled from that MIDI data to in real-time change the stylization of our render. Then we'll move on to OSC and we'll use an iPad running TouchOSC to send OSC data into Unreal, and then we'll learn how to control objects in real-time, in Unreal, from this wireless hardware controller.
And then what we're going to do finally with Unreal, is we're going to get the data off a Kinect sensor into Unreal, and learn how we can control object and particle movement, in Unreal, from the data flowing in off a Kinect, as we move around a room. So these are two fantastic real-time 3D graphics systems that have different strengths for different projects. And we're going to learn how we can use real-time controllers to drive some great results in both of them.
Related Courses
-
Learning Houdini
with Scott Pagano2h 56m Intermediate -
Cinema 4D R17 Essential Training
with Craig Whitaker6h 23m Beginner -
Unreal Essential Training (2016)
with Craig Barr7h 39m Beginner -
Maya: Motion Graphics Workflow with MASH
with Scott Pagano3h 33m Intermediate
-
Introduction
-
Welcome1m 34s
-
-
1. TouchDesigner: MIDI
-
MIDI device mapper4m 37s
-
MIDI input component6m 36s
-
Build effects UI5m 14s
-
Connect MIDI to effects UI5m 35s
-
Effects 1: Blur7m 48s
-
Effects 2: RGB9m 39s
-
Effects 3: Feedback, part 27m 39s
-
Effects 3: Feedback, part 35m 35s
-
-
2. TouchDesigner: OSC
-
OSC overview2m 23s
-
TouchOSC layout6m 21s
-
OSC input component7m 17s
-
Controlling objects with OSC6m 13s
-
Particles: GPU, part 15m 28s
-
Particles: GPU, part 22m 51s
-
-
3. TouchDesigner: Kinect
-
Kinect setup2m 25s
-
Kinect input component3m 3s
-
-
4. Unreal Engine: MIDI
-
Post-process material6m 52s
-
5. Unreal Engine: OSC
-
TouchOSC: UI Layout1m 33s
-
Blueprint 1: OSC input5m 59s
-
Blueprint 2: Moving geometry7m 37s
-
6. Unreal Engine: Kinect
-
Blueprint 1: Kinect input6m 10s
-
Conclusion
-
Next steps1m 39s
-
- Mark as unwatched
- Mark all as unwatched
Are you sure you want to mark all the videos in this course as unwatched?
This will not affect your course history, your reports, or your certificates of completion for this course.
CancelTake notes with your new membership!
Type in the entry box, then click Enter to save your note.
1:30Press on any video thumbnail to jump immediately to the timecode shown.
Notes are saved with you account but can also be exported as plain text, MS Word, PDF, Google Doc, or Evernote.
Share this video
Embed this video
Video: Welcome