IFD:Acoustic Interfaces: Difference between revisions

From Medien Wiki
No edit summary
No edit summary
 
(15 intermediate revisions by 2 users not shown)
Line 1: Line 1:
[[:Category:Fachmodul|Fachmodul]] <br/>
[[:Category:Fachmodul|Fachmodul]] <br/>
'''Printing Acoustic Interfaces'''<br />
'''Acoustic Interfaces'''<br />
''Instructor:'' [[Clemens Wegener]]<br/>
''Instructor:'' [[Clemens Wegener]]<br/>
''Credits:'' 6 [[ECTS]], 2 [[SWS]]<br/>
''Credits:'' 6 [[ECTS]], 2 [[SWS]]<br/>
''Capacity:'' max. 12 students<br/>
''Capacity:'' max. 10 students<br/>
''Language:'' English<br/>
''Language:'' English<br/>
''Location:'' Marienstrasse 7B, R002<br/>
''Location:'' Online Streaming and Material<br/>
''First Meeting:'' '''9th April 2019, 9:15 AM'''
''First Meeting:'' '''tba'''


==Description==
==Description==
This course focuses on printing acoustic sensors for the sensing of structure-born sound. Print processes like silver ink-jet and screen printing can be applied to manufacture acoustic sensors. Tapping and sliding gestures on an acoustic surface have a different sound impact, which can be leveraged to design new interaction concepts. The course focuses on developing a concept for acoustic interaction and developing a working prototype with appropriate sensors and signal processing abilities to materialize your concepts.
We are constantly surrounded by electronic interfaces: elevators, automatic doors, ticket machines, remote controls, voice recognition systems, etc. With a high degree of networking between our devices, interfaces must seamlessly integrate into ecosystems of information acquisition and processing. Information acquisition and processing are becoming increasingly spatially separated. Thus, ergonomic sensor placement, which integrates discreetly into our accustomed environment, is gaining ground.
 
The course explores the possibilities of this ergonomic, embedded interaction using the example of acoustic interfaces. We will develop electronic sensor systems for the detection of vibrations (structure-borne sound) in integrated surfaces and experiment with machine learning methods to differentiate between vibration gestures (e.g. knocking noises, friction noises, etc.).
 
The Course will be taught in video sessions and regular assignments every two weeks.
 
If you are interested, please send a letter of motivation and portfolio to clemens.wegener ( at ) uni-weimar (dot) de.


==Admission requirements==
==Admission requirements==
Knowledge in Hard- and Software would be highly appreciated, but is not a requirement.The needed functional components will be explained throughout the course. In parallel you will develope your own interaction concepts or product prototypes. For buying electronic components, a little budget of 10€ to 20€ is neccessary. Of course you can keep your manufactured works.
 
===Things you need===
* computer or laptop
* Teensy 4.0 + audio shield
* a pair of headphones or speakers
* a soldering iron would be a plus
 
 
We will use either the Teensy 4.0 hardware platform or the Raspberry Pi to classify sounds in the environment. Therefore, a budget of (30-40€) should be planned for the Teensy and other components.
 
===Educational Requirements===
 
Introductory level of programming is a requirement!


==Evaluation==
==Evaluation==
Successful completion of the course is dependent on regular attendance, active participation, completion of assignments, delivery of a relevant semester prototype and documentation. Please refer to the [[/EvaluationPAISS19 |Evaluation Rubric]] for more details.
Successful completion of 50% of the assignments. Realization and documentation of a completed semester prototype and a final video presentation. Please refer to the [[/EvaluationAISS20 |Evaluation Rubric]] for more details.


==Eligible participants==
==Eligible participants==
Qualified MFA Medienkunst/-gestaltung, MFA Media Art and Design, MSc MediaArchitecture candidates <br />
Qualified MFA Medienkunst/-gestaltung, MFA Media Art and Design, MSc MediaArchitecture candidates <br />


==Syllabus (subject to change)==
==Syllabus==
* Session 1: Examples of acoustic interfaces
Coming soon...
* Session 2: Introduction to printed electronics workflow
* Session 3: Brainstorm for project proposals
* Session 4: Workshop: Printed electronics
* Session 5: Introduction to the electronic workshop and tools
* Session 6: Amplifier circuits and technology
* Session 7: Prototyping Workshop 1
* Session 8: Prototyping Workshop 2
* Session 9: Connecting to Arduino or Raspberry Pi
* Session 10: Audio signal processing in Pure Data 1
* Session 11: Audio signal processing in Pure Data 2
* …
* Session XX: Final project presentations (9th July)


==Course Material==
==Course Material==


* [[/introduction to electronics/]]
* [[/introduction to c++/]]
* [[/acoustic sensing circuits/]]
 
For the time of the course, the material will reside in the internal learning platform and will be released here soon.


==Further Reading==
==Further Reading==
Suganuma, Katsuaki: Introduction to Printed Electronics. New York: Springer Science+Business Media, 2014.
Y. Kawahara, S. Hodges, N. Gong, S. Olberding and J. Steimle, "Building Functional Prototypes Using Conductive Inkjet Printing," in IEEE Pervasive Computing, vol. 13, no. 3, pp. 30-38, July-Sept. 2014.


Zamborlin, Bruno. 2015. Studies on customisation-driven digital music instruments. Doctoral thesis, Goldsmiths, University of London.
Zamborlin, Bruno. 2015. Studies on customisation-driven digital music instruments. Doctoral thesis, Goldsmiths, University of London.
Line 51: Line 55:
Rasamimanana, N.H., Bevilacqua, F., Schnell, N., Guédy, F., Fléty, E., Maestracci, C., Zamborlin, B., Frechin, J., & Petrevski, U. (2010). Modular musical objects towards embodied control of digital music. Tangible and Embedded Interaction.
Rasamimanana, N.H., Bevilacqua, F., Schnell, N., Guédy, F., Fléty, E., Maestracci, C., Zamborlin, B., Frechin, J., & Petrevski, U. (2010). Modular musical objects towards embodied control of digital music. Tangible and Embedded Interaction.


Jones, Randy & Driessen, Peter & Schloss, W & Tzanetakis, George. (2009). A Force-Sensitive Surface for Intimate Control.


==Pure Data Patches==
==Pure Data Patches==
[[:File:draw_envelope.pd]]
[[:File:draw_envelope.pd]]
==Setting Up the Raspberry Pi==
* You will need an SD card reader for Micro SD cards (eventually and SD card adapter)
* Download [https://etcher.io/ etcher] and [https://blokas.io/patchbox-os/ PatchboxOS]
* Install balenaEtcher and launch
* Select downloaded PatchboxOS image and press flash
* Plug Your SD Card to the Raspberry Pi
* If you don't have a Raspberry Pi 3: Plug Your USB WIFI to the Raspberry
* Start it up!


==Links==
==Links==


Inspiration for your projects:
*[https://youtu.be/6DDkwdPaYmk Blendie]
 
*[https://vimeo.com/329853386 Gary Hill, "Wall Piece"]
*[https://vimeo.com/301199365 Hyper Surfaces]
*[https://vimeo.com/301199365 Hyper Surfaces]
*[https://youtu.be/Vj-WVcsr2GQ Mogees Play]
*[https://youtu.be/Vj-WVcsr2GQ Mogees Play]
Line 77: Line 70:
*[https://www.youtube.com/watch?v=GEJCmrhrBjc PebbleBox]
*[https://www.youtube.com/watch?v=GEJCmrhrBjc PebbleBox]
*[https://www.youtube.com/watch?v=Uhps_U2E9OM Modular Musical Objects]
*[https://www.youtube.com/watch?v=Uhps_U2E9OM Modular Musical Objects]
*[https://www.youtube.com/watch?v=X6XE8IJOsZ0 Tangible Acoustic Interfaces for Computer-Human Interaction: Sound Table]
*[https://www.youtube.com/watch?v=eRlhKaxcKpA Sven König - sCrAmBlEd?HaCkZ! ]
[[Category: Clemens Wegener]]
[[Category:SS20]]

Latest revision as of 15:20, 29 December 2020

Fachmodul
Acoustic Interfaces
Instructor: Clemens Wegener
Credits: 6 ECTS, 2 SWS
Capacity: max. 10 students
Language: English
Location: Online Streaming and Material
First Meeting: tba

Description

We are constantly surrounded by electronic interfaces: elevators, automatic doors, ticket machines, remote controls, voice recognition systems, etc. With a high degree of networking between our devices, interfaces must seamlessly integrate into ecosystems of information acquisition and processing. Information acquisition and processing are becoming increasingly spatially separated. Thus, ergonomic sensor placement, which integrates discreetly into our accustomed environment, is gaining ground.

The course explores the possibilities of this ergonomic, embedded interaction using the example of acoustic interfaces. We will develop electronic sensor systems for the detection of vibrations (structure-borne sound) in integrated surfaces and experiment with machine learning methods to differentiate between vibration gestures (e.g. knocking noises, friction noises, etc.).

The Course will be taught in video sessions and regular assignments every two weeks.

If you are interested, please send a letter of motivation and portfolio to clemens.wegener ( at ) uni-weimar (dot) de.

Admission requirements

Things you need

  • computer or laptop
  • Teensy 4.0 + audio shield
  • a pair of headphones or speakers
  • a soldering iron would be a plus


We will use either the Teensy 4.0 hardware platform or the Raspberry Pi to classify sounds in the environment. Therefore, a budget of (30-40€) should be planned for the Teensy and other components.

Educational Requirements

Introductory level of programming is a requirement!

Evaluation

Successful completion of 50% of the assignments. Realization and documentation of a completed semester prototype and a final video presentation. Please refer to the Evaluation Rubric for more details.

Eligible participants

Qualified MFA Medienkunst/-gestaltung, MFA Media Art and Design, MSc MediaArchitecture candidates

Syllabus

Coming soon...

Course Material

For the time of the course, the material will reside in the internal learning platform and will be released here soon.

Further Reading

Zamborlin, Bruno. 2015. Studies on customisation-driven digital music instruments. Doctoral thesis, Goldsmiths, University of London.

Murray-Smith, Roderick & Williamson, John & Hughes, Stephen & Quaade, Torben. (2008). Stane: Synthesized surfaces for tactile input. Conference on Human Factors in Computing Systems - Proceedings. 1299-1302. 10.1145/1357054.1357257.

Rasamimanana, N.H., Bevilacqua, F., Schnell, N., Guédy, F., Fléty, E., Maestracci, C., Zamborlin, B., Frechin, J., & Petrevski, U. (2010). Modular musical objects towards embodied control of digital music. Tangible and Embedded Interaction.


Pure Data Patches

File:draw_envelope.pd

Links