Skip to content

Gesture=Sound Experiments : Process and Mappings

Ross Bencina, Danielle Wilde, and Somaya Langley

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper reports on outcomes of a residency undertaken at STEIM, Amsterdam, in July 2007. Our goal was to explore methods for working with sound and whole body gesture, with an open experimental approach. In many ways this work can be characterised as prototype development. The sensor technology employed was three-axis accelerometers in consumer gamecontrollers. Outcomes were intentionally restrained to strippedback experimental results. This paper discusses the processes and strategies for developing the experiments, as well as providing background and rationale for our approach. We describe "vocal prototyping" -- a technique for developing new gesture-sound mappings, the mapping techniques applied, and briefly describe a selection of our experimental results.

Citation

Ross Bencina, Danielle Wilde, and Somaya Langley. 2008. Gesture=Sound Experiments : Process and Mappings. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1179491 [PDF]

BibTeX Entry


@inproceedings{nime2008_Bencina,
author = {Bencina, Ross and Wilde, Danielle and Langley, Somaya},
title = {Gesture=Sound Experiments : Process and Mappings},
pages = {197--202},
booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
year = {2008},
address = {Genoa, Italy},
issn = {2220-4806},
doi = {10.5281/zenodo.1179491},
url = {https://nime.org/proceedings/2008/nime2008_197.pdf},
keywords = {gestural control,mapping,nime08,prototyping,three-axis accelerometers,vocal,wii remote},
abstract = {This paper reports on outcomes of a residency undertaken at STEIM, Amsterdam, in July 2007. Our goal was to explore methods for working with sound and whole body gesture, with an open experimental approach. In many ways this work can be characterised as prototype development. The sensor technology employed was three-axis accelerometers in consumer gamecontrollers. Outcomes were intentionally restrained to strippedback experimental results. This paper discusses the processes and strategies for developing the experiments, as well as providing background and rationale for our approach. We describe "vocal prototyping" -- a technique for developing new gesture-sound mappings, the mapping techniques applied, and briefly describe a selection of our experimental results.}
}