69
edits
No edit summary |
|||
Line 24: | Line 24: | ||
===Technical approach=== | ===Technical approach=== | ||
[[File:Immersive Collage Processing-Chain.jpg|thumb|some first thoughts on the processing chain]] | [[File:Immersive Collage Processing-Chain.jpg|thumb|some first thoughts on the processing chain]] | ||
The current | The current plan is to analyze the incoming live audio data via some semantical analysis ([http://williambrent.conflations.com/pages/research.html timbreID] for PD) and use the results to trigger a generative collage and of the picture-footage that is found on the internet or shot by the webcams evey now and then(?). A goal is to design some nice algorithms that put together different parts of images in relation to the sonic events. As an example: If you hear some waves of San Diego beach or some car traffic, the computer decodes the sound as a wave, which then causes the pixels from the images to appear in a wavelike movement that is related to the sound etc...(potential latencies are not a problem) | ||
The different parts of the images would then fade-out gently after some moments to be displaced by new pixel data. | The different parts of the images would then fade-out gently after some moments to be displaced by new pixel data. | ||
===Current experiments=== | |||
* MIR (musical information retreivment): setting up some [http://williambrent.conflations.com/pages/research.html timbreID]- PD patch. If we train the system to recognize typical weimar sounds, then what will happen if it is employed on soundscapes from San Diego later on? Which sounds work fine, which don't? Are there interesting misinterpretations? | |||
* Setting up an audiovisual data stream | |||
* Collecting ideas and visualizations for image transformations. What looks nice? What are subjective associations one could try to code? e.g: | |||
noise: bird sounds -> visualization: flocking; | |||
noise: surf -> visualization: undulation | |||
… | |||
* Writing a programm (with [http://www.openframeworks.cc/ openFrameworks], maybe in connection with [http://marsyasweb.appspot.com/ marsyas] if the PD analysis isn't satisfying) that can implement the ideas. Experiments on generative (stereoscopic?) pixel transformations. | |||
===Participants=== | ===Participants=== |
edits