12,297
edits
PDCON:Conference/A Pd framework for the Xth Sense: enabling computers to sense human kinetic behaviour: Difference between revisions
PDCON:Conference/A Pd framework for the Xth Sense: enabling computers to sense human kinetic behaviour (view source)
Revision as of 12:23, 10 June 2011
, 10 June 2011no edit summary
mNo edit summary |
mNo edit summary |
||
| Line 8: | Line 8: | ||
To what extent could biologic sounds be employed musically? In which ways could the performer's perceptual experience be affected? How could such experimental paradigm motivate an original perspective on musical performance? | To what extent could biologic sounds be employed musically? In which ways could the performer's perceptual experience be affected? How could such experimental paradigm motivate an original perspective on musical performance? | ||
This paper seeks to outline methods underlying the development of the Xth Sense project, an ongoing research which investigates exploratory applications of biophysical sound design for musical performance and responsive milieux. Presently the Xth Sense technology consists of a low-cost, biosensing wearable hardware device and a Pure Data based application for capture, analysis and real time processing of human muscle sounds. | This paper seeks to outline methods underlying the development of the Xth Sense project, an ongoing research which investigates exploratory applications of biophysical sound design for musical performance and responsive milieux. Presently the Xth Sense technology consists of a low-cost, biosensing wearable hardware device and a [[Pure Data]] based application for capture, analysis and real time processing of human muscle sounds. | ||
Firstly, an exploratory study of the acoustics of body sounds, namely muscle sounds is illustrated. I describe the development of an audio synthesis model for muscle sounds which offered a deeper understanding of the body sound matter and provided the ground for further experimentations in signal processing and composition in Pd. Then follows a description of the development and design of the Xth Sense - a wearable hardware sensor device for capturing biological body sounds. Eventually I describe the development of the DSP modular application, focusing on its main features such as: a MMG features extraction methods, a GOP routing system for dynamic mapping of gesture to sound, real time audio processing models and GUI utilities, which were developed to provide a fast prototyping environment. | Firstly, an exploratory study of the acoustics of body sounds, namely muscle sounds is illustrated. I describe the development of an audio synthesis model for muscle sounds which offered a deeper understanding of the body sound matter and provided the ground for further experimentations in signal processing and composition in Pd. Then follows a description of the development and design of the Xth Sense - a wearable hardware sensor device for capturing biological body sounds. Eventually I describe the development of the DSP modular application, focusing on its main features such as: a MMG features extraction methods, a GOP routing system for dynamic mapping of gesture to sound, real time audio processing models and GUI utilities, which were developed to provide a fast prototyping environment. | ||
In conclusion, I elaborate on the implementation of the Xth Sense framework in the composition of Music for Flesh II, a solo musical performance; which realization process prompted a better understanding of muscle sounds capabilities for biophysical generation and control of music, thus providing further prospects for the inquiry. | In conclusion, I elaborate on the implementation of the Xth Sense framework in the composition of Music for Flesh II, a solo musical performance; which realization process prompted a better understanding of muscle sounds capabilities for biophysical generation and control of music, thus providing further prospects for the inquiry. | ||