PDCON:Conference/A Pd framework for the Xth Sense: enabling computers to sense human kinetic behaviour: Difference between revisions
No edit summary |
mNo edit summary |
||
| (14 intermediate revisions by 3 users not shown) | |||
| Line 3: | Line 3: | ||
Author: Marco Donnarumma | Author: Marco Donnarumma | ||
Download full paper: [[Media:A Pd framework for the Xth Sense-enabling computers to sense human kinetic behaviour.pdf]] | |||
The [http://res.marcodonnarumma.com/ Xth Sense] is an interactive system for the biophysical generation and control of music. It makes use of muscle sounds (MMG<ref>[[wikipedia:Mechanomyogram]]</ref>) produced by a performer as both raw sonic material and control data. Presently the Xth Sense (XS) technology consists of low-cost, wearable biosensors and a [[Pure Data]] based application for capture, analysis, real time processing and playback of human muscle sounds. The technical implementation of the XS biosensors has been recently illustrated<ref>M. Donnarumma: “Xth Sense: researching muscle sounds for an experimental paradigm of musical performance” Proceedings of the Linux Audio Conference (LAC'11), 2011</ref>. | |||
This paper describes the design of the XS software; it is a program that enables a computer to “listen” to the MMG signals transduced by the XS biosensors, to understand the performance main features, and therefore to interact with the performer. After a brief introduction on the nature of the interaction fostered by the XS technology, I focus on the framework main features such as: the XS library, a tabbed dynamic interface (TDI), a MMG features extraction unit, and a graph-on-parent (GOP) routing system for dynamic mapping of gesture to sound. | |||
[[PDCON:Concerts/Marco Donnarumma|Music for Flesh II]], is a solo sound piece for the Xth Sense. | |||
<videoflash type="vimeo">36962709|700|400</videoflash> | |||
== References == | |||
<references/> | |||
{{Template:PdCon11}} | |||
Latest revision as of 15:31, 20 February 2012
A Pd framework for the Xth Sense: enabling computers to sense human kinetic behaviour
Author: Marco Donnarumma
Download full paper: Media:A Pd framework for the Xth Sense-enabling computers to sense human kinetic behaviour.pdf
The Xth Sense is an interactive system for the biophysical generation and control of music. It makes use of muscle sounds (MMG[1]) produced by a performer as both raw sonic material and control data. Presently the Xth Sense (XS) technology consists of low-cost, wearable biosensors and a Pure Data based application for capture, analysis, real time processing and playback of human muscle sounds. The technical implementation of the XS biosensors has been recently illustrated[2].
This paper describes the design of the XS software; it is a program that enables a computer to “listen” to the MMG signals transduced by the XS biosensors, to understand the performance main features, and therefore to interact with the performer. After a brief introduction on the nature of the interaction fostered by the XS technology, I focus on the framework main features such as: the XS library, a tabbed dynamic interface (TDI), a MMG features extraction unit, and a graph-on-parent (GOP) routing system for dynamic mapping of gesture to sound.
Music for Flesh II, is a solo sound piece for the Xth Sense.
<videoflash type="vimeo">36962709|700|400</videoflash>
References
- ↑ wikipedia:Mechanomyogram
- ↑ M. Donnarumma: “Xth Sense: researching muscle sounds for an experimental paradigm of musical performance” Proceedings of the Linux Audio Conference (LAC'11), 2011
4th international Pure Data Convention 2011 Weimar ~ Berlin