PDCON:Workshops/AUDIENCE: Difference between revisions

Latest revision as of 09:13, 19 July 2011

Instructor: Regis Rossi Faria

Keywords: spatial audio, sound scene production, auralization, sound immersion, spatial audio processing

AUDIENCE for Pd is a library for spatial audio with which users can build 2D/3D sound scenes, assign their sounds to objects within the scene and play it through several surround modes. The applicative can be used to build auralization patches and to provide audio immersion to other applications. Its operation is sound-scene oriented, enabling to work independently the sound scene composition, its acoustic rendering, its encoding in a suitable multichannel format, and finally its auralization, using 2D or 3D sound fields. A major feature of it is the sound scene conception independence from the listening mode, as the user can work out a desired sound scene spatial experience regardless of the loudspeaker configuration used to listen. The system is comprised of a collection of patches and externals compiled to OSX, Win32 and Linux. A typical project flow involves creating a sound scene (layer 1 object), configuring an acoustic rendering scheme (layer 2 object), encoding the spatial sound of the rendered scene (layer L3 object) and then decoding and playing the sound scene through a loudspeaker rig (layer 4 object). Auxiliary functions, such as transport, mixing and volume controls are available from objects in an auxiliary layer. AUDIENCE is presently employed as auralization engine in a CAVE system at the University of São Paulo, and has been further used as reference audio engine for reconfigurable digital music applications, soundscape design applications and scene-oriented mixing. The system is going to its 3rd. generation, with planned improvements in the usability and sound fidelity, expanding the number of spatial processing functions, and looking forward to enlarging its platform availability to prospecting new applications and user groups.

The workshop will introduce the system, show how to install and to work with it.

Sponsors and partners of the 4th internationals Pure Data Convention in Weimar 2011

4^th international Pure Data Convention 2011 Weimar ~ Berlin

@@ Line 1: / Line 1: @@
-=== further information will follow soon ===
+Instructor: Regis Rossi Faria
-Keywords: spatial audio, sound scene production, auralization, sound immer=
+Keywords: spatial audio, sound scene production, auralization, sound immersion, spatial audio processing
-sion, spatial audio processing
-AUDIENCE for Pd is library for audio immersion, sound scene production and auralization. The software enables to work independently the sound scene composition, its acoustic rendering, encoding it in a suitable multichannel format, and finally auralizing it using 2D or 3D sound fields. A major feature of it is the sound scene conception independence from the listening mode, as the user can work out a desired sound scene spatial experience regardless of the loudspeaker configuration used to listen. The AUDIENCE library distribution is organized in 12 directories containing the main spatial processing layers (L1, L2, L3, L4), an auxiliary functions layer, reference applications, supportive libraries, binaries, images and sounds, test patches and documentation. A typical project flow involves creating a sound scene (layer 1 object), configuring an acoustic rendering scheme (layer 2 object), encoding the spatial sound of the rendered scene (layer L3 object) and then decoding and auralizing the sound scene through a loudspeaker rig (layer 4 object). Auxiliary functions, such as transport, mixing and volume controls are available from objects in the auxiliary layer. The full distribution version 2.0.2 supports a scalable interactive sound scene graphical user interface, Ambisonics (up to the 3rd order) and MPEG-4 AAC codecs, image-source-based acoustic simulation, multichannel recording and playing (including 5.1) and it can decode to 10 different speaker layouts. Currently a new acoustic simulator with ray-tracing and radiosity support, loudness management and object-oriented timeline features are under development. The architecture is scalable: many scenes and sound sources can be combined, while real time interaction placing and moving objects in the scenes is possible. The final sound field can be exported and played back in stereo and surround output formats. AUDIENCE and its open version OpenAUDIENCE are been developed collaboratively since 2005 at the Audio Engineering and Coding Center (NEAC) in the University of São Paulo, and have been used in several scientific and artistic projects since then. In 2007 it was used to spatialize the piece =E2=80=9CThe Unanswered Question=E2=80=9D by Charles Ives (1906) with 9 instruments (a string quartet, a wind quartet and a trumpet). In the same year its underlying architecture was proposed as framework for the new MPEG SAOC (Spatial Audio Object Coding) codec. In 2009 the electro-acoustic piece  =E2=80=9CKitchen=E2=
+AUDIENCE for Pd is a library for spatial audio with which users can build 2D/3D sound scenes, assign their sounds to objects within the scene and play it through several surround modes. The applicative can be used to build auralization patches and to provide audio immersion to other applications. Its operation is sound-scene oriented, enabling to work independently the sound scene composition, its acoustic rendering, its encoding in a suitable multichannel format, and finally its auralization, using 2D or 3D sound fields. A major feature of it is the sound scene conception independence from the listening mode, as the user can work out a desired sound scene spatial experience regardless of the loudspeaker configuration used to listen. The system is comprised of a collection of patches and externals compiled to OSX, Win32 and Linux. A typical project flow involves creating a sound scene (layer 1 object), configuring an acoustic rendering scheme (layer 2 object), encoding the spatial sound of the rendered scene (layer L3 object) and then decoding and playing the sound scene through a loudspeaker rig (layer 4 object). Auxiliary functions, such as transport, mixing and volume controls are available from objects in an auxiliary layer. AUDIENCE is presently employed as auralization engine in a CAVE system at the University of São Paulo, and has been further used as reference audio engine for reconfigurable digital music applications, soundscape design applications and scene-oriented mixing. The system is going to its 3rd. generation, with planned improvements in the usability and sound fidelity, expanding the number of spatial processing functions, and looking forward to enlarging its platform availability to prospecting new applications and user groups.
-=80=9D by Fernando-Lopez Lezcano, with 8 sound sources, was spatialized during the SBCM 2009 symposium in Recife. AUDIENCE is presently employed as auralization engine in a CAVE system at the University of São Paulo, and has been further used as reference audio engine for reconfigurable digital music applications, soundscape design applications and scene-oriented mixing. The system development is going to its 3rd. generation, designing improvements in the usability and sound fidelity, expanding the number of spatial processing functions, and looking forward to enlarging its platform availability to prospecting new applications and user groups.
-The workshop is introducing the system and showing how to install and work with it.
+The workshop will introduce the system, show how to install and to work with it.
+{{Template:PdCon11}}
+[[Category:Workshop]]
+[[Category:Pure Data]]
+[[Category:Spatialisation]]
+[[Category:Ambisonics]]