Luise Krumbein

FINAL PROJECT IDEA: Pulse — distorting live images

A normal pulse is regular in rhythm and strength. Sometimes it is higher, sometimes lower, depending on the situation and health condition.You rarely see it and feel it from time to time. Apart from the visualisation of an EKG, what could it look like?

I would like to use an Arduino pulse sensor to create an interactive installation. The setup contains the pulse sensor and a screen. The user can easily connect to the Max by clipping the Arduino sensor to his finger. The webcam is connected and shows the image of the participant. The pulse sensor visually distorts the webcam image and creates a new result. The user can interact by trying to get his pulse higher, e.g. by moving.

A more complex version would be the interaction of two pulses. Two Arduino pulse sensors are connected to MAX and one distorted webcam image is showing the combination of pulses from two people. This idea could be further developed during the semester.

How does it work: Arduino pulse sensor that measures the pulse with the fingers. Usually, this is used to measure the radial pulse. This has a reason: the finger closest to the heart is used to occlude the pulse pressure, the middle finger is used get a crude estimate of the blood pressure, and the finger most distal to the heart (usually the ring finger) is used to nullify the effect of the ulnar pulse as the two arteries are connected via the palmar arches (superficial and deep). In MAX, a patch must be created in which the data from Arduino is converted into parameters which distorts the image.

Here are some links for the pulse sensor and image distortion videos.

• webcam interaction [1]
• distorting images [2]
• Arduino pulse sensor tutorial [3]
• Arduino pulse sensor [4]

PROJECT THOUGHTS

Please take a look at Johannes Schneemann Project idea 1

What does the space we share online look like?

Participants in an online meeting share a virtual space without having the same circumstances. What circumstances influence a meeting in reality? Someone might be cold or hot, very noisy, the washing machine is running in the background, late at night or early in the morning with a time shift...

The shared virtual space should be represented by its own added member of the BBB conference displaying an interactive moving image. It is generated from data collected from all participants at the time of the meeting. For 5 participants, the parameters are: body temperature, room temperature, pulse, time, noise. This non-visual data is translated into visual images. The room we are sharing online gets another dimension.

I have to admit that it won’t be technically feasible in this short time (real time data exchange, embed in BBB, interactive visualisation)

Homework 3

Sensing physical parameters File:Luise Krumbein_homework 3.maxpat

Video: https://www.youtube.com/watch?v=5iw1E1od4O8

Homework 2

1. Sound to number File:Luise Krumbein homework 2_part 1.maxpat

Load video

Local File

Local File might collect personal data.

ContinueDismiss

2. Video analysis File:Luise Krumbein_homework 2_part 2.maxpat

Homework 1

First patch File:210422_Luise Krumbein.maxpat

Projects from other students: F.Z. Aygüler [5] Wei Ru Tai [6]