Kinect: Difference between revisions

Latest revision as of 13:40, 6 June 2013

The Microsoft® XBOX 360 Kinect is a motion controller developped by PrimeSense. It projects a pattern with infrared light and calculates a depth image using a camera. It also has a color camera and four microphones. The Y axis of the sensor is remote controllable with an in-build motor. The color of the LED is settable by software as well.

About

Blogs and portals

Software

Applications

CocoaKinect App Freenect by Robert Pointon
Synapse generates sceleton data and provides it as OSC
ofxFaceTracker provides face metrics (orientation, eye and mouth open/closed) over OSC
codelaboratories.com/kb/nui
TUIO Kinect lets you define a depth range where multiple blobs can be detected. No actual depth information can be extracted.
ReconstructMe turns your Kinect into a 3D-Scanner
KinectA is a free application by Bauhaus-Universität Alumna Michaela Honauer for motion tracking via the KinectSensor - including hand, skeleton and object tracking. Communication to other hard- and software via OSC.
NI-Mate
RGBDToolkit Workflow for Kinect + DSLR Filmmaking
faceshift markerless facial motion capture in the future also:
Sensecast lite Application/Framework for gesture recognition

SDKs, Frameworks and Libraries

Depth image

openkinect.org Drivers, Installation
pix_freenect for Pd (incl. binaries work without any compiling)
fux_kinect Object for Pd
ofxKinect openFramworks Kinect integration
vvvv kinect integration

Skeleton data

OpenNI
Pd-LA: Howto install Kinect on OS X 10.6.x
Howto install openNI kinect drivers and NITE on gentoo Linux
Ubuntu PPA by Hans-Christoph Steiner including OpenNI, OSCeleton, Primesense Kinect and NITE
OSCeleton takes kinect skeleton data from the OpenNI framework and outputs the coordinates of the skeleton's joints via OSC messages. These can can then be used on your language / framework of choice. Needs openNI.
Pure Data patch to receive and visualize the skeleton data from osceleton Needs OSCeleton (which needs OpenNI)
how to install openNI on OS X using macports and visualize the skeleton in Max/MSP (or Pd)
skeleton data in Quartz Composer via Max/MSP
iisu

Running depth image and skeleton data on workstation Rafael

Change user of the computer to admin (Apple menu: logout user/User abmelden). Make sure Kinect is connected.

Depth image in Pd

open Pd
open pix_freenect-help.pd in Folder kinect on harddrive Rafael Data RAID
open gemwin and activate the accel toggle

Skeleton Data in Pd

open the terminal and Pd
in the terminal type: cd /Volumes/Rafael\ Data\ RAID/kinect/Sensebloom-OSCeleton OR: type: cd (+ space) and drag the folder Sensebloom-OSCeleton from Folder kinect on harddrive Rafael Data RAID into the terminal window
Enter. Type ./osceleton (optional: If you want to change the port add: "-p" and the port number. If you want to see the picture the Kinect is tracking add: "-w"), then press enter again.
Because OSCeleton has some hiccups i recommend adding a "while true" loop to make sure it starts again when a problem appears. Makes the command: "while true; do ./osceleton; done"
open OSCeleton.pd from Folder pd-skeleton in Folder kinect on harddrive Rafael Data RAID with Pd

Successors/Competitors

Asus Xtion (PRO, PRO Live)
https://www.leapmotion.com
http://duo3d.com
http://www.softkinetic.com producer of TOF CMOS Sensors (and possibly manufacturer of the Kinect 3 module?)

@@ Line 1: / Line 1: @@
-The Microsoft® XBOX 360 Kinect is a motion controller. It projects a pattern with infrared light and calculates a depth image using a camera. It also has a color camera and four microphones. The Y axis of the sensor is remote controllable with an in-build motor. The color of the LED is settable by software as well.
+The Microsoft® XBOX 360 Kinect is a motion controller developped by [http://www.primesense.com PrimeSense]. It projects a pattern with infrared light and calculates a depth image using a camera. It also has a color camera and four microphones. The Y axis of the sensor is remote controllable with an in-build motor. The color of the LED is settable by software as well.
 == About ==
@@ Line 5: / Line 5: @@
 * [[wikipedia:Kinect]]
 * [http://www.dailymail.co.uk/sciencetech/article-1190240/You-controller-Microsoft-unveils-Xbox-360-device-banishes-joypad-puts-player-IN-game.html www.dailymail.co.uk/sciencetech]
+* [http://video.wired.com/watch/new-xbox-kinect-exclusive-wired-video-398878 next generation Kinect]
 === Blogs and portals ===
 * http://www.kinecthacks.com
 * http://kinect.dashhacks.com
-* http://www.creativeapplications.net/kinect/
+* http://www.creativeapplications.net/kinect
 == Software ==
@@ Line 19: / Line 21: @@
 * [http://reconstructme.net/ ReconstructMe] turns your Kinect into a 3D-Scanner [[File:Icon windows8 16x16.png]]
 * [http://kinecta.mihoo.de KinectA] is a free application by Bauhaus-Universität Alumna [[User:Michaa|Michaela Honauer]] for motion tracking via the KinectSensor - including hand, skeleton and object tracking. Communication to other hard- and software via OSC. [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
-* [http://rgbdtoolkit.com RGBDToolkit] Workflow for Kinect + DSLR Filmmaking [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
+* [http://www.ni-mate.com NI-Mate] [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
+* [http://rgbdtoolkit.com RGBDToolkit] Workflow for Kinect + DSLR Filmmaking [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
 * [http://www.faceshift.com faceshift] markerless facial motion capture  [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]] in the future also: [[File:Icon newtux 16x16.png]]
+* [http://sensecast.com/downloads Sensecast lite] Application/Framework for gesture recognition
-=== Frameworks and Libraries ===
+=== SDKs, Frameworks and Libraries ===
 ==== Depth image ====
 * [http://openkinect.org openkinect.org] Drivers, Installation
-* [http://www.matthiaskronlachner.com/?p=299 pix_freenect] for Pd (binaries work without any compiling)
+* [http://www.matthiaskronlachner.com/?p=299 pix_freenect] for Pd [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]] (incl. binaries work without any compiling)
 * [https://github.com/badgeek/fux_kinect fux_kinect Object] for Pd
 * [https://github.com/ofTheo/ofxKinect ofxKinect] openFramworks Kinect integration
@@ Line 31: / Line 35: @@
 ==== Skeleton data ====
-* [http://www.openni.org/Downloads.aspx OpenNI]
+* [http://www.openni.org/openni-sdk OpenNI]
 * [http://pd-la.info/kinect/kinect-mac-os-x Pd-LA: Howto install Kinect] on OS X 10.6.x
 * Howto install [http://www.keyboardmods.com/2010/12/howto-kinect-openninite-skeleton.html openNI kinect drivers and NITE] on gentoo Linux
 * [https://launchpad.net/~eighthave/+archive/openni Ubuntu PPA by Hans-Christoph Steiner] including OpenNI, OSCeleton, Primesense Kinect and NITE
-* [https://github.com/Sensebloom/OSCeleton OSCeleton] takes kinect skeleton data from the OpenNI framework and outputs the coordinates of the skeleton's joints via OSC messages. These can can then be used on your language / framework of choice. Needs openNI.
+* [https://github.com/Sensebloom/OSCeleton OSCeleton] takes kinect skeleton data from the OpenNI framework and outputs the coordinates of the skeleton's joints via OSC messages. These can can then be used on your language / framework of choice. Needs openNI.[[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]]  [[File:Icon windows8 16x16.png]]
 * [https://github.com/pd-projects/pd-kinect-skeleton Pure Data patch to receive and visualize the skeleton data from osceleton] Needs OSCeleton (which needs OpenNI)
 * [http://pkmital.com/home/2011/01/24/streaming-motion-capture-data-from-the-kinect-using-osc-on-mac-osx how to install openNI on OS X using macports] and visualize the skeleton in Max/MSP (or Pd)
 * [http://mansteri.com/2011/01/osceleton-with-quartz-composer skeleton data in Quartz Composer via Max/MSP]
+* [http://www.softkinetic.com/fr-be/products/iisumiddleware.aspx iisu]
 == Running depth image and skeleton data on workstation ''Rafael'' ==
@@ Line 54: / Line 59: @@
 # Because OSCeleton has some hiccups i recommend adding a "while true" loop to make sure it starts again when a problem appears. Makes the command: "while true; do ./osceleton; done"
 # open <tt>OSCeleton.pd</tt> from Folder <tt>pd-skeleton</tt> in Folder <tt>kinect</tt> on harddrive <tt>Rafael Data RAID</tt> with Pd
+== Successors/Competitors ==
+* [http://www.asus.com/Multimedia/Motion_Sensor_Products Asus Xtion (PRO, PRO Live)]
+* https://www.leapmotion.com
+* http://duo3d.com
+* http://www.softkinetic.com producer of TOF CMOS Sensors (and possibly manufacturer of the Kinect 3 module?)
 [[Category:Pure Data]]