I am interested in tracking small, subconscious movements made by humans. Last semester I developed an eye tracking programme, made in Processing, which uses colour selection and face recognition to draw the paths of movements made by eyes.
With an earlier version of the programme, I made some tests with recordings of my eyes whilst using a computer, starting after ten minutes of surfing the internet.
Now I want to bring this into the space of the performance platform and map tiny eye movements onto a moving 3D object. This object will be a hanging paper 'wall', serving to restrict the view of two people from one another. Standing opposite yet unable to see the other, communication or interaction is made possible via moving the wall, both intentionally and unintentionally. Upon entering the space, it will be obvious that another person is present but it will not be immediately clear as to what is causing the structure to move. They eye movements of each person will compete or combine to create the overall motion. I want to track the paths made by the combined interactions of humans, eye movements and the object in order to determine whether we tend to fall into the same patterns of motion, individually or as a group.
How it works
The processing sketch picks up eye movement data via the cameras and activates servo motors in the structure, causing the wall to move at locations 'hit' by the gazes. The paper wall is constructed in such a way as to allow a ripple effect through the entire structure each time a motor is activated.
Video of eye tracking programme
Video of how the paper structure could be made
Different possibilities for making the wall. Some alternatives for cubes which move in a more organic way.
Trying out different ways of creating movement mechanically. In order to use servos, I need to transform circular motion into linear motion to push up at the ball from the inside. After failing to create a desirable movement with wooden beads, I began to look at making an umbrella-like construction. I also tried using muscle wire (a thin flexible wire which shrinks when current passes through and then returns to its original state) which turned out to be difficult to control and also to make quicker or larger movements.
I also added 'trigger' points to my eye tracking programme which each set off a different servo motor whenever an eye is tracked at that position. This involved setting up a serial port communication between Arduino and Processing.
Video of tests with various mechanical options and muscle wire
Development of umbrella idea with plan to make specific umbrella structure to fit the shape of the origami exactly. Also an idea to simplify the servo mechanics by attaching a small wooden shape to the horn of the servo which would push up on the bottom of the umbrella as it turns.
