GMU:Digital Puppetry Lab/Group KittenRemote: Difference between revisions

From Medien Wiki
No edit summary
 
(72 intermediate revisions by 3 users not shown)
Line 1: Line 1:
"Kitten Remote"
== Kitten in Space! ==


We have designed a video game whereby the player is controlled by a touch osc app. The game sounds are generated in max msp, Iannix sends messages via osc to max and max sends triggers onto unity to control the scale of the game object.


Touch OSC APP with Game Controller
Our concept was to realise an interactive ‘mini’ game in Unity controlled via touch OSC for smartphone. The sound accompanying the game is generated in Max MSP via OSC triggers from Iannix, this data is then transferred via OSC to affect the scale value in real time of the cube game objects in Unity.  
[[Image:OSC_APP.png]]


Meooow!


Unity TouchOSC Receiver
== Group Work By ==
<li>Florian Froger (Unity & TouchOSC App Implementation)
<li>Jonas Jülch (Unity & TouchOSC App Implementation)


[[Image:OSC_Touch_Receiver_Code.jpg]]
== OSC Signal Diagram ==
[[File:oscdiagram.jpg]]
 
== Iannix - Audio Input ==
 
We created a simple score in Iannix to send triggers via OSC to be received in Max MSP.
 
[[File:Iannix.png|600px]]
 
== Max MSP - Audio Input/Output ==
 
In Max we assembled a patch that triggers sound files responding to incoming OSC messages from Iannix. A bank of sound files pre-designed in Ableton are stored in a folder on the hard drive and called from the max patch as it receives the random trigger coordinates into the sprintf open %s.wav object. These triggers are then sent on to be received in Unity via the udpsend object in Max.
 
[[File:Maxsounds.mp3]]
 
[[Image:Max1.png|600px]]
 
== Controller Input to Unity ==
 
Touch OSC App
 
We used the App "TouchOSC" for Android to control our Kitten in Unity. The design of the layout is inspired by the classic Nintendo controller.
 
Effectively we used the "Directional Pad" to move our Kitten on the x and z axis and the blue button to jump.
 
TouchOSC is communicating directly with Unity via OSC.
 
[[Image:OSC_APP.png|600px]]
 
== Unity TouchOSC Receiver Code ==
 
This is the script we used to get the connection between Unity and TouchOSC established.
 
In the "function update" part we move the player around. We receive the variables for this function via the function "AllMessageHandler" which you can find in the second part of the code.
 
We used the following Unity Scene and it's included scripts as a template
 
https://github.com/heaversm/unity-osc-receiver
 
[[Image:OSC_Touch_Receiver_Code.jpg|800px]]
 
== Video Doc ==
 
[https://www.youtube.com/embed/RNqw7ycQNXA
]

Latest revision as of 23:44, 12 December 2017

Kitten in Space!

Our concept was to realise an interactive ‘mini’ game in Unity controlled via touch OSC for smartphone. The sound accompanying the game is generated in Max MSP via OSC triggers from Iannix, this data is then transferred via OSC to affect the scale value in real time of the cube game objects in Unity.

Meooow!

Group Work By

  • Florian Froger (Unity & TouchOSC App Implementation)
  • Jonas Jülch (Unity & TouchOSC App Implementation)

    OSC Signal Diagram

    Oscdiagram.jpg

    Iannix - Audio Input

    We created a simple score in Iannix to send triggers via OSC to be received in Max MSP.

    Iannix.png

    Max MSP - Audio Input/Output

    In Max we assembled a patch that triggers sound files responding to incoming OSC messages from Iannix. A bank of sound files pre-designed in Ableton are stored in a folder on the hard drive and called from the max patch as it receives the random trigger coordinates into the sprintf open %s.wav object. These triggers are then sent on to be received in Unity via the udpsend object in Max.

    File:Maxsounds.mp3

    Max1.png

    Controller Input to Unity

    Touch OSC App

    We used the App "TouchOSC" for Android to control our Kitten in Unity. The design of the layout is inspired by the classic Nintendo controller.

    Effectively we used the "Directional Pad" to move our Kitten on the x and z axis and the blue button to jump.

    TouchOSC is communicating directly with Unity via OSC.

    OSC APP.png

    Unity TouchOSC Receiver Code

    This is the script we used to get the connection between Unity and TouchOSC established.

    In the "function update" part we move the player around. We receive the variables for this function via the function "AllMessageHandler" which you can find in the second part of the code.

    We used the following Unity Scene and it's included scripts as a template

    https://github.com/heaversm/unity-osc-receiver

    OSC Touch Receiver Code.jpg

    Video Doc

    [https://www.youtube.com/embed/RNqw7ycQNXA ]