GMU:Dataflow/Jam session/Kei Kitamura

From Medien Wiki

Concept

This is an experiment to change the texture of videos.
A video of audience, which comes from internal webcam of the computer, is transformed by external multiple 2D coordinates.
The aim of this experiment is to represent a different impression while people see what they usually see in their life, by changing textures.
It is the first step of giving different look by texture visual effects.


File

The max patch can be downloaded from here;
Media:Pixel_sampling_test_02.maxpat

Also, here is the patch I used for osc communication with other patches
Media:OSC_Network.maxpat

Methods

1. Capture a video from the webcam

KK dataflow step1.png


Using jit.brab object, the video from a webcam can be captured and integrated with other max objects.
The captured video is sent to jit.matrix object.
In the sample patch, a large toggle button in the center of the window activates this step.


2.Generate noise maps for masking

KK dataflow step2.png


Next to the video capture part, there are some objects to generate a monochrome nonise texture.
jit.bfg object generates actual noise, and it enables to select several types of noise.
In this patch, a simplex noise is used, but there is another noise mask using curl noise in this patch.


KK dataflow step3.png




Result

KK chromakey.png


KK dataflow chromakey.png


KK dataflow offset.png


KK dataflow overview.png


KK dataflow result.png