GMU:Digital Puppetry Lab/Group Swarm

Group Tasks

-Emilio Aguas: Input development (Processing or TouchOSC), Sound output implementation (Max/Msp sound patch)
-Fiona Mortimer: Visual output implementation and music development (Max/Msp/Jitter video patch)
-Eduardo Oliviera: Visual output implementation and music development (Max/Msp/Jitter video patch)

Concept idea

- Thinking about an external input we came up with the idea to use our voices as an input. Something like take the change in the decibels every time you speak into a mic. but after several trials it was better to take another direction so we decided to take the acceleration data from a mobile device and do something with that.

In our case we took the path to manipulate the acceleration values in X, Y and Z axis, so with that in mind we tried to develop an sound output that was loud and annoying like when a hornet pass by flying and also generate a swarm and chaotic visual output of this same concept.

Data flow diagramm

Tips...
On the mobile phone the outgoing port it's set up on 8000 so for the first laptop we need the same port number, on the first laptop the outgoing port is the 9000, so the receiving port in the second laptop should be 9000.

Step by step implementation

TouchOSC

1. Download and install touchOSC into your mobile device android or iphone:
Iphone
Android"

2. Set up your on your mobile device
- under connections tap on osc, then enabled and on host assign the Ip address of the first laptop, and assign the outgoing port to 8000
- after, under options panel tap it and enabled the accelerometer (/xyz)
- then choose a layout or create your own with TouchOsc editor if you need more info about touch osc here is a Editor tutorial
-finally go to the layout to start sending the acc data via OSC protocol

Connection setup on TouchOSC

Options setup on TouchOSC

Create your own canvas or user interface to manipulate midi or osc data

TouchOSC simple canvas layout

Max Sound Patch

OSC patch receiver sender and sound output

Max/Msp sound patch

- In this patch at the top you have the receiver object with the port 8000, then the route from the acceleration "/accxyz".

- then with unpack object the values are split in three and all of them are float values between -1.0 and 1.0, for these values to be useful we are going to scale it now from 0 till 127 so the data now are integers, we use the sliders as a visual aid to see the behaviour of the acc values.

- after those values goes to the make note object that creates a midi tone with a velocity to transmit the values as sound we create a note out object and also to visualize this in a musical scale we use an n-slider object.

-Finally the pack object is used to create an array of integers and send it to the second laptop with the udpsend object.

-Tip: is useful to create a print object just to see in the console how the data is sent