What has been done so far:
- Testing receiving data from Arduino to Touchdesigner using Ultrasonic Distance Sensor (only for this test)
- Manipulating 3D object using data received from Arduino
Links used for this step: Feedback in Touchdesigner, TOUCHDESIGNER & ARDUINO
- Audio-reactive 3D model
Links used for this step: Instancing in Touchdesigner, Touchdesigner audio analysis
What's next?
Arduino
- Send pulse data to TD
- Send to Emotion recognition code
Python | Emotion recognition
- Emotion recognition
- Send data to TD
Touchdesinger
- test other forms of 3D (point clouds/ more complex instancing/....)
- try other sets of reactions to music
- create multiple scenes for different emotions
- intersection with Arduino: reaction to the pulse input
- intersection with python: trigger change in scenes by the emotional input