Kinect: Difference between revisions

Revision as of 01:56, 29 December 2011

The Microsoft® XBOX 360 Kinect is a motion controller. It projects a pattern with infrared light and calculates a depth image using a camera. It also has a color camera and four microphones. The Y axis of the sensor is remote controllable with an in-build motor. The color of the LED is settable by software as well.

About

Blogs and portals

Software

Apps (ready to run)

Cocoa freenect App (OS X) by Robert Pointon
codelaboratories.com/kb/nui Windows
TUIO Kinect lets you define a depth range where multiple blobs can be detected. No actual depth information can be extracted.

Frameworks and Libraries

Depth image

openkinect.org Drivers, Installation
pix_freenect for Pd (binaries work without any compiling)
fux_kinect Object for Pd
ofxKinect openFramworks Kinect integration
vvvv kinect integration

Skeleton data

OpenNI
Pd-LA: Howto install Kinect on OS X 10.6.x
Howto install openNI kinect drivers and NITE on OS X 10.6
Howto install openNI kinect drivers and NITE on gentoo Linux
Ubuntu PPA by Hans-Christoph Steiner including OpenNI, OSCeleton, Primesense Kinect and NITE
OSCeleton takes kinect skeleton data from the OpenNI framework and outputs the coordinates of the skeleton's joints via OSC messages. These can can then be used on your language / framework of choice. Needs openNI.
Pure Data patch to receive and visualize the skeleton data from osceleton Needs OSCeleton (which needs OpenNI)
how to install openNI on OS X using macports and visualize the skeleton in Max/MSP (or Pd)
skeleton data in Quartz Composer via Max/MSP

Running depth image and skeleton data on workstation Rafael

Change user of the computer to admin (Apple menu: logout user/User abmelden). Make sure Kinect is connected.

Depth image in Pd

open Pd
open pix_freenect-help.pd in Folder kinect on harddrive Rafael Data RAID
open gemwin and activate the accel toggle

Skeleton Data in Pd

open the terminal and Pd
in the terminal type: cd /Volumes/Rafael\ Data\ RAID/kinect/Sensebloom-OSCeleton OR: type: cd (+ space) and drag the folder Sensebloom-OSCeleton from Folder kinect on harddrive Rafael Data RAID into the terminal window
Enter. Type ./osceleton (optional: If you want to change the port add: "-p" and the port number. If you want to see the picture the Kinect is tracking add: "-w"), then press enter again.
Because OSCeleton has some hiccups i recommend adding a "while true" loop to make sure it starts again when a problem appears. Makes the command: "while true; do ./osceleton; done"
open OSCeleton.pd from Folder pd-skeleton in Folder kinect on harddrive Rafael Data RAID with Pd

@@ Line 46: / Line 46: @@
 # open the terminal and Pd
 # in the terminal type: <tt>cd /Volumes/Rafael\ Data\ RAID/kinect/Sensebloom-OSCeleton</tt> OR: type: <tt>cd </tt>(+ space) and drag the folder <tt>Sensebloom-OSCeleton</tt> from Folder <tt>kinect</tt> on harddrive <tt>Rafael Data RAID</tt> into the terminal window
-# Enter. Type <tt>./osceleton</tt>, then press enter again
+# Enter. Type <tt>./osceleton</tt> (optional: If you want to change the port add: "-p" and the port number. If you want to see the picture the Kinect is tracking add: "-w"), then press enter again.
-# If you want to change the port add: "-p" and the port number
-# If you want to see the picture the Kinect is tracking add: "-w"
 # Because OSCeleton has some hiccups i recommend adding a "while true" loop to make sure it starts again when a problem appears. Makes the command: "while true; do ./osceleton; done"
 # open <tt>OSCeleton.pd</tt> from Folder <tt>pd-skeleton</tt> in Folder <tt>kinect</tt> on harddrive <tt>Rafael Data RAID</tt> with Pd