Join Scott Pagano for an in-depth discussion in this video OSC overview, part of TouchDesigner & Unreal: Interactive Controllers.
- [Narrator] In this chapter, we're going to learn how to control scenes in Touch Designer, using OSC Messages. OSC stands for Open Sound Control, and it's a protocol for sending messages between different applications and controllers, and it's really fantastic. So what we're going to do right now, is I'm just going to show you the OSC in CHOPs. We're in an empty touch scene here, I'm going to hit Tab, type O-S-C, In, lay this down, by default, I'm going to change it's network port to 8000, and the reason for that is we have a controller set up that's sending on that port.
And we're just going to show you a little test here so you can see what's going on. Alright, so I'm going to hit Play on my scene, I'm going to move my finger around on my controller, and there's a little XY pad, and we're going to illustrate this and record the controller for you later, but just showing you, we have some position data coming in here, I've got some switches coming in here, doing some different things, so this is just showing a different kind of data that you can see is named differently, and has different kind of addresses that we can bring in to Touch Designer. For this course, what we're going to do is we're going to be using Touch OSC, so let me go over to my browser here, and Touch OSC is an app that you can download for an IOS or an Android device, that allows you to build a customizable control panel, using these, you know, fantastic tablet devices, where we have multi touch, real time control, and then make custom messages to send them over into Touch Designer.
And this is really fantastic, because for a very low price here, you can see, we can build a really custom UI, and control a scene untethered from the computer, using a wireless device. So there's two components of Touch OSC, there's the actual app that runs on your device, which you can download via whatever app store you need for your device, and then you go over here as well, and this hexler.net/software/touchosc, and so this is the page that has information about this app, and shows you all the different apps that it works with, and shows you some examples of different interfaces you can build with it, and then down here you can see, there's an editor to download, and you can download it for your appropriate platforms.
And this is the program that enables you to build a custom UI that you then transfer to your ipad or Android device, that can then send messages back into Touch Designer. Alright, so that's the overview of what we need to get going with this, and next up we're going to be looking in the editor, building a custom control panel, sending it to our device, and then we'll move on to actually controlling a scene in Touch Designer with our UI on our wireless device.
This course focuses on using interactive hardware controllers to drive real-time 3D scenes in TouchDesigner and Unreal Engine. In TouchDesigner, look at a MIDI controller with sliders that you can use to drive the creation of effects in a real-time rendering system. Next, learn about using TouchOSC to build a custom UI that you can transfer to an iPad that sends OSC messages to TouchDesigner. Then, learn how to use those messages to move particles and objects around on screen. To wrap up, learn how to get data off of a Kinect sensor into TouchDesigner so you can control that same particle and object movement. The course also covers MIDI, OSC, and Kinect as they apply to Unreal Engine.
- Using TouchOSC to build a custom UI
- Transferring a custom UI to an iPad
- Controlling objects with OSC
- Setting up Kinect
- Getting data off of a Kinect sensor and into TouchDesigner
- Using OSC messages to move particles and objects around
- Installing VS and downloading the plug-in
- Creating a C++ Unreal project and compiling a plugin
- Installing the Kinect 4 Unreal plugin