Gesture Control of Sounds in 3D Space

Jan C. Schacher

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2007
• Location: New York City, NY, United States
• Pages: 358–362
• Keywords: Gesture, Surround Sound, Mapping, Trajectory, Transform Matrix, Tree Hierarchy, Emergent Structures.
• DOI: 10.5281/zenodo.1177241 (Link to paper)
• PDF link

Abstract:

This paper presents a methodology and a set of tools for gesture control of sources in 3D surround sound. The techniques for rendering acoustic events on multi-speaker or headphone-based surround systems have evolved considerably, making it possible to use them in real-time performances on light equipment. Controlling the placement of sound sources is usually done in idiosyncratic ways and has not yet been fully explored and formalized. This issue is addressed here with the proposition of a methodical approach. The mapping of gestures to source motion is implemented by giving the sources physical object properties and manipulating these characteristics with standard geometrical transforms through hierarchical or emergent relationships.

Citation:

BibTeX Entry:

  @inproceedings{Schacher2007,
 abstract = {This paper presents a methodology and a set of tools for gesture control of sources in 3D surround sound. The techniques for rendering acoustic events on multi-speaker or headphone-based surround systems have evolved considerably, making it possible to use them in real-time performances on light equipment. Controlling the placement of sound sources is usually done in idiosyncratic ways and has not yet been fully explored and formalized. This issue is addressed here with the proposition of a methodical approach. The mapping of gestures to source motion is implemented by giving the sources physical object properties and manipulating these characteristics with standard geometrical transforms through hierarchical or emergent relationships. },
 address = {New York City, NY, United States},
 author = {Schacher, Jan C.},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177241},
 issn = {2220-4806},
 keywords = {Gesture, Surround Sound, Mapping, Trajectory, Transform Matrix, Tree Hierarchy, Emergent Structures. },
 pages = {358--362},
 title = {Gesture Control of Sounds in {3D} Space},
 url = {http://www.nime.org/proceedings/2007/nime2007_358.pdf},
 year = {2007}
}