GMU:Tutorials/Visual Interaction

From Medien Wiki

How to control Unity with Max/Msp


In this tutorial, you will get the basic ideas of interactive connection between Unity and Max/Msp, using open sound control (OSC).
You will try to control noise deformation intensity of a mesh object as an example.

There are some materials you need to test this tutorial.
Please download and install following plugins before you start;

-OSC plugins for Unity
OSC_Plugins_for_Unity.zip

-OSC plugins for Max/Msp
http://cnmat.berkeley.edu/patch/4029

-Perlin noise plugin for Unity
PerlinNoise.zip

-Scripts for Unity
UnityNoise_Scripts.zip

Make a OSC bridge on Max/Msp

In this section, you will make a OSC sender part on Max/Msp.

1.Open a new patcher from top menu bar. You can also make a new patcher with shortcuts "command" + "K".

2.Press "F" key to make a number box for float. This will be the input of the noise contoroller.

3.Press "M" key to make a message node and type "/test $1" and connect with the number box.
"/test" is an identifier of the osc message. You can rename whatever you want, but you should pay attention not to forget "/" before the name of identifier.
Also, "$1" is required to import external value.

4.Press "B" to make a bang node and press "N" and type "OpenSoundControl".

5.Press "N" and type "udpsend 127.0.0.1 2222".
"127.0.0.1" is a IP address, which is used to test this setup internally.
If you try this tutorial with multiple computers, check the IP address of a computer for Unity project.
"2222" is a name of port. You can define any integer, but make sure that you are using the same port number for Max patch and Unity.

6.Connect nodes together like the picture below;

MaxMsp 01 06.png
















7. Then, lock the patcher with "command"+ "E". Now you are ready to run the "sender" part.

Make a OSC bridge on Unity

In this section, you will make OSC receiver part on Unity.

1.Open Unity and make a new project folder.
You will see the window like this picture;

Unity 02 01.png













Click the "NEW" icon on the top right of the window to make a new project folder.
Then you can name the project folder and define the place you make.

Unity 02 02.png













Make sure that you are selecting "3D" mode. If you are selecting, its color is red.

2.Create "Empty" game object from the create button on the "Hierarchy" tab, which is top left on the window.

Unity 02 04.png













Then, right click created game object and rename it "OSC Receiver".
In this tutorial, all scripts related to OSC will be attached on this game object.

3.Right click on the "Project" tab on the bottom left of the window.
Create 2 folders and name them "Scripts" and "Plugins".

Unity 02 06.png













Then, drug and drop downloaded Unity plugins named "Osc.cs", "Udp.cs", "Perlin.cs" to "Plugins" folder.
Also, you drug and drop Unity scripts called "OSCReceiver.js" to "Scripts" folder.
In Unity, there are some special folder name for specific types of objects.
You can find detailed information on References part.

4. Click "OSC Receiver" game object. The detailed information about this game object appears on the "Inspector" tab on the right side of the window. Drug and drop"Osc.cs", "Udp.cs" and "OSCReceiver.js" on it.

Unity 02 11.png













5. If you try this tutorial on your computer internally, make sure that "OSC Receiver" script uses the same IP address and port name on "Listener Port".
If you try it with multiple computers, modify parameters of "OSC Receiver" script on the Inspector tab.

Prepare a noise animation script on Unity

In this section, you will develop the object which you animate with OSC signals.

References

You can downloaded finished sample project files from this link;

Max patch
NoiseController.maxpat.zip

Unity Project
PerlinNoiseDeformation.zip

There is detailed description about special folder name on Unity project.
https://docs.unity3d.com/Manual/SpecialFolders.html