Join Scott Pagano for an in-depth discussion in this video Install VS and download the plugin, part of TouchDesigner & Unreal: Interactive Controllers.
- [Instructor] In this chapter, we're going to take a look at how we can control Unreal with OSC data, and OSC is a protocol that allows us to transfer messages of all different kinds between applications. And in this chapter, we're going to use a special app that we can download and install on an iPad that allows us to build custom user interfaces that send OSC data that we can then pipe into Unreal, and this is a really fantastic way to build custom UIs and sort of basically, custom controllers to control Unreal Engine in a an Untethered way from a wireless device.
So here we are at the opensoundcontrol website. We're not going to really go through any of this information, but I wanted to pull this up so you can see a little bit more information about it. And the second thing we're going to need here is we're going to need to go over to the GitHub page for the Unreal Engine for OSC plugin. By default, Unreal doesn't have OSC support, but nice people have built a plugin that we can easily download and install. So what we're going to do is just go over here and say download and say download Zip. Alright, so we're going to download the UE for OSC plugin, and then, the final thing we need to do to set this up so we can make it work right is we're going to go over to the Microsoft website and we're going to download Microsoft Visual Studio Community 2015, which is free.
And what this is going to do is this is going to enable everything to compile because this plugin is actually in source code form and we need to compile it. And this may sound a little scary or intimidating if you're not used to working with C++ or any sort of code, and full disclosure, I don't work with that stuff either myself. I'm not a programmer. I don't write C++. I don't know any of those things, but one of the really amazing things about the way this stuff is all built is if we have everything installed properly and we set it up, the plugin is going to compile automatically for us and we're not going to need to anything in code land.
So next up, we're going to move on to building an empty C++ project and installing the plugin.
This course focuses on using interactive hardware controllers to drive real-time 3D scenes in TouchDesigner and Unreal Engine. In TouchDesigner, look at a MIDI controller with sliders that you can use to drive the creation of effects in a real-time rendering system. Next, learn about using TouchOSC to build a custom UI that you can transfer to an iPad that sends OSC messages to TouchDesigner. Then, learn how to use those messages to move particles and objects around on screen. To wrap up, learn how to get data off of a Kinect sensor into TouchDesigner so you can control that same particle and object movement. The course also covers MIDI, OSC, and Kinect as they apply to Unreal Engine.
- Using TouchOSC to build a custom UI
- Transferring a custom UI to an iPad
- Controlling objects with OSC
- Setting up Kinect
- Getting data off of a Kinect sensor and into TouchDesigner
- Using OSC messages to move particles and objects around
- Installing VS and downloading the plug-in
- Creating a C++ Unreal project and compiling a plugin
- Installing the Kinect 4 Unreal plugin