Kinect: Difference between revisions

From Medien Wiki
 
(32 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The Microsoft® XBOX 360 Kinect is a motion controller. It projects a pattern with infrared light and calculates a depth image using a camera. It also has a color camera and four microphones. The Y axis of the sensor is remote controllable with an in-build motor. The color of the LED is settable by software as well.
The Microsoft® XBOX 360 Kinect is a motion controller developped by [http://www.primesense.com PrimeSense]. It projects a pattern with infrared light and calculates a depth image using a camera. It also has a color camera and four microphones. The Y axis of the sensor is remote controllable with an in-build motor. The color of the LED is settable by software as well.


== About ==
== About ==
Line 5: Line 5:
* [[wikipedia:Kinect]]
* [[wikipedia:Kinect]]
* [http://www.dailymail.co.uk/sciencetech/article-1190240/You-controller-Microsoft-unveils-Xbox-360-device-banishes-joypad-puts-player-IN-game.html www.dailymail.co.uk/sciencetech]
* [http://www.dailymail.co.uk/sciencetech/article-1190240/You-controller-Microsoft-unveils-Xbox-360-device-banishes-joypad-puts-player-IN-game.html www.dailymail.co.uk/sciencetech]
* [http://video.wired.com/watch/new-xbox-kinect-exclusive-wired-video-398878 next generation Kinect]
=== Blogs and portals ===
=== Blogs and portals ===
* http://www.kinecthacks.com
* http://www.kinecthacks.com
* http://kinect.dashhacks.com
* http://kinect.dashhacks.com
* http://www.creativeapplications.net/kinect/
* http://www.creativeapplications.net/kinect


== Software ==
== Software ==
=== Apps (ready to run) ===
=== Applications ===
* [http://fernlightning.com/doku.php?id=randd:kinect Cocoa freenect App] (OS X) by Robert Pointon
* [http://fernlightning.com/doku.php?id=randd:kinect CocoaKinect App] Freenect by Robert Pointon [[File:Icon apple 16x16.png]]
* [http://synapsekinect.tumblr.com Synapse] gets the sceleton data and provides it as OSC
* [http://synapsekinect.tumblr.com Synapse] generates sceleton data and provides it as OSC [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [https://github.com/kylemcdonald/ofxFaceTracker ofxFaceTracker] provides face metrics (orientation, eye and mouth open/closed) over OSC
* [https://github.com/kylemcdonald/ofxFaceTracker ofxFaceTracker] provides face metrics (orientation, eye and mouth open/closed) over OSC
* [http://codelaboratories.com/kb/nui codelaboratories.com/kb/nui] Windows
* [http://codelaboratories.com/kb/nui codelaboratories.com/kb/nui] [[File:Icon windows8 16x16.png]]
* [https://code.google.com/p/tuiokinect TUIO Kinect] lets you define a depth range where multiple blobs can be detected. No actual depth information can be extracted.
* [https://code.google.com/p/tuiokinect TUIO Kinect] lets you define a depth range where multiple blobs can be detected. No actual depth information can be extracted. [[File:Icon apple 16x16.png]]
* [http://reconstructme.net/ ReconstructMe] turns your Kinect into a 3D-Scanner
* [http://reconstructme.net/ ReconstructMe] turns your Kinect into a 3D-Scanner [[File:Icon windows8 16x16.png]]
* [http://kinecta.mihoo.de KinectA] is a free application by Bauhaus-Universität Alumna [[User:Michaa|Michaela Honauer]] for motion tracking via the KinectSensor - including hand, skeleton and object tracking. Communication to other hard- and software via OSC. [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://www.ni-mate.com NI-Mate] [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://rgbdtoolkit.com RGBDToolkit] Workflow for Kinect + DSLR Filmmaking [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]]
* [http://www.faceshift.com faceshift] markerless facial motion capture  [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]] in the future also: [[File:Icon newtux 16x16.png]]
* [http://sensecast.com/downloads Sensecast lite] Application/Framework for gesture recognition


*
=== SDKs, Frameworks and Libraries ===
 
=== Frameworks and Libraries ===
==== Depth image ====
==== Depth image ====
* [http://openkinect.org openkinect.org] Drivers, Installation
* [http://openkinect.org openkinect.org] Drivers, Installation
* [http://www.matthiaskronlachner.com/?p=299 pix_freenect] for Pd (binaries work without any compiling)
* [http://www.matthiaskronlachner.com/?p=299 pix_freenect] for Pd [[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]] [[File:Icon windows8 16x16.png]] (incl. binaries work without any compiling)
* [https://github.com/badgeek/fux_kinect fux_kinect Object] for Pd
* [https://github.com/badgeek/fux_kinect fux_kinect Object] for Pd
* [https://github.com/ofTheo/ofxKinect ofxKinect] openFramworks Kinect integration
* [https://github.com/ofTheo/ofxKinect ofxKinect] openFramworks Kinect integration
Line 30: Line 35:


==== Skeleton data ====
==== Skeleton data ====
* [http://www.openni.org/Downloads.aspx OpenNI]
* [http://www.openni.org/openni-sdk OpenNI]
* [http://pd-la.info/kinect/kinect-mac-os-x Pd-LA: Howto install Kinect] on OS X 10.6.x
* [http://pd-la.info/kinect/kinect-mac-os-x Pd-LA: Howto install Kinect] on OS X 10.6.x
* Howto install [http://kinecthesis.bakedmac.com/2011/01/11/installing-openni-kinect-drivers-and-nite-on-mac-os-x-10-6 openNI kinect drivers and NITE] on OS X 10.6
* Howto install [http://www.keyboardmods.com/2010/12/howto-kinect-openninite-skeleton.html openNI kinect drivers and NITE] on gentoo Linux
* Howto install [http://www.keyboardmods.com/2010/12/howto-kinect-openninite-skeleton.html openNI kinect drivers and NITE] on gentoo Linux
* [https://launchpad.net/~eighthave/+archive/openni Ubuntu PPA by Hans-Christoph Steiner] including OpenNI, OSCeleton, Primesense Kinect and NITE
* [https://launchpad.net/~eighthave/+archive/openni Ubuntu PPA by Hans-Christoph Steiner] including OpenNI, OSCeleton, Primesense Kinect and NITE
* [https://github.com/Sensebloom/OSCeleton OSCeleton] takes kinect skeleton data from the OpenNI framework and outputs the coordinates of the skeleton's joints via OSC messages. These can can then be used on your language / framework of choice. Needs openNI.
* [https://github.com/Sensebloom/OSCeleton OSCeleton] takes kinect skeleton data from the OpenNI framework and outputs the coordinates of the skeleton's joints via OSC messages. These can can then be used on your language / framework of choice. Needs openNI.[[File:Icon newtux 16x16.png]] [[File:Icon apple 16x16.png]]  [[File:Icon windows8 16x16.png]]
* [https://github.com/pd-projects/pd-kinect-skeleton Pure Data patch to receive and visualize the skeleton data from osceleton] Needs OSCeleton (which needs OpenNI)
* [https://github.com/pd-projects/pd-kinect-skeleton Pure Data patch to receive and visualize the skeleton data from osceleton] Needs OSCeleton (which needs OpenNI)
* [http://pkmital.com/home/2011/01/24/streaming-motion-capture-data-from-the-kinect-using-osc-on-mac-osx how to install openNI on OS X using macports] and visualize the skeleton in Max/MSP (or Pd)
* [http://pkmital.com/home/2011/01/24/streaming-motion-capture-data-from-the-kinect-using-osc-on-mac-osx how to install openNI on OS X using macports] and visualize the skeleton in Max/MSP (or Pd)
* [http://mansteri.com/2011/01/osceleton-with-quartz-composer skeleton data in Quartz Composer via Max/MSP]
* [http://mansteri.com/2011/01/osceleton-with-quartz-composer skeleton data in Quartz Composer via Max/MSP]
* [http://www.softkinetic.com/fr-be/products/iisumiddleware.aspx iisu]


== Running depth image and skeleton data on workstation ''Rafael'' ==
== Running depth image and skeleton data on workstation ''Rafael'' ==
Line 54: Line 59:
# Because OSCeleton has some hiccups i recommend adding a "while true" loop to make sure it starts again when a problem appears. Makes the command: "while true; do ./osceleton; done"  
# Because OSCeleton has some hiccups i recommend adding a "while true" loop to make sure it starts again when a problem appears. Makes the command: "while true; do ./osceleton; done"  
# open <tt>OSCeleton.pd</tt> from Folder <tt>pd-skeleton</tt> in Folder <tt>kinect</tt> on harddrive <tt>Rafael Data RAID</tt> with Pd
# open <tt>OSCeleton.pd</tt> from Folder <tt>pd-skeleton</tt> in Folder <tt>kinect</tt> on harddrive <tt>Rafael Data RAID</tt> with Pd
== Successors/Competitors ==
* [http://www.asus.com/Multimedia/Motion_Sensor_Products Asus Xtion (PRO, PRO Live)]
* https://www.leapmotion.com
* http://duo3d.com
* http://www.softkinetic.com producer of TOF CMOS Sensors (and possibly manufacturer of the Kinect 3 module?)


[[Category:Pure Data]]
[[Category:Pure Data]]

Latest revision as of 13:40, 6 June 2013

The Microsoft® XBOX 360 Kinect is a motion controller developped by PrimeSense. It projects a pattern with infrared light and calculates a depth image using a camera. It also has a color camera and four microphones. The Y axis of the sensor is remote controllable with an in-build motor. The color of the LED is settable by software as well.

About

Blogs and portals

Software

Applications

  • CocoaKinect App Freenect by Robert Pointon Icon apple 16x16.png
  • Synapse generates sceleton data and provides it as OSC Icon apple 16x16.png Icon windows8 16x16.png
  • ofxFaceTracker provides face metrics (orientation, eye and mouth open/closed) over OSC
  • codelaboratories.com/kb/nui Icon windows8 16x16.png
  • TUIO Kinect lets you define a depth range where multiple blobs can be detected. No actual depth information can be extracted. Icon apple 16x16.png
  • ReconstructMe turns your Kinect into a 3D-Scanner Icon windows8 16x16.png
  • KinectA is a free application by Bauhaus-Universität Alumna Michaela Honauer for motion tracking via the KinectSensor - including hand, skeleton and object tracking. Communication to other hard- and software via OSC. Icon apple 16x16.png Icon windows8 16x16.png
  • NI-Mate Icon newtux 16x16.png Icon apple 16x16.png Icon windows8 16x16.png
  • RGBDToolkit Workflow for Kinect + DSLR Filmmaking Icon apple 16x16.png Icon windows8 16x16.png
  • faceshift markerless facial motion capture Icon apple 16x16.png Icon windows8 16x16.png in the future also: Icon newtux 16x16.png
  • Sensecast lite Application/Framework for gesture recognition

SDKs, Frameworks and Libraries

Depth image

Skeleton data

Running depth image and skeleton data on workstation Rafael

Change user of the computer to admin (Apple menu: logout user/User abmelden). Make sure Kinect is connected.

Depth image in Pd

  1. open Pd
  2. open pix_freenect-help.pd in Folder kinect on harddrive Rafael Data RAID
  3. open gemwin and activate the accel toggle

Skeleton Data in Pd

  1. open the terminal and Pd
  2. in the terminal type: cd /Volumes/Rafael\ Data\ RAID/kinect/Sensebloom-OSCeleton OR: type: cd (+ space) and drag the folder Sensebloom-OSCeleton from Folder kinect on harddrive Rafael Data RAID into the terminal window
  3. Enter. Type ./osceleton (optional: If you want to change the port add: "-p" and the port number. If you want to see the picture the Kinect is tracking add: "-w"), then press enter again.
  4. Because OSCeleton has some hiccups i recommend adding a "while true" loop to make sure it starts again when a problem appears. Makes the command: "while true; do ./osceleton; done"
  5. open OSCeleton.pd from Folder pd-skeleton in Folder kinect on harddrive Rafael Data RAID with Pd

Successors/Competitors