SoundGrasp : A Gestural Interface for the Performance of Live Music

Thomas Mitchell, and Imogen Heap

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper documents the first developmental phase of aninterface that enables the performance of live music usinggestures and body movements. The work included focuseson the first step of this project: the composition and performance of live music using hand gestures captured using asingle data glove. The paper provides a background to thefield, the aim of the project and a technical description ofthe work completed so far. This includes the developmentof a robust posture vocabulary, an artificial neural networkbased posture identification process and a state-based system to map identified postures onto a set of performanceprocesses. The paper is closed with qualitative usage observations and a projection of future plans.

Citation

Thomas Mitchell, and Imogen Heap. 2011. SoundGrasp : A Gestural Interface for the Performance of Live Music. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178111

BibTeX Entry

@inproceedings{Mitchell2011,
 abstract = {This paper documents the first developmental phase of aninterface that enables the performance of live music usinggestures and body movements. The work included focuseson the first step of this project: the composition and performance of live music using hand gestures captured using asingle data glove. The paper provides a background to thefield, the aim of the project and a technical description ofthe work completed so far. This includes the developmentof a robust posture vocabulary, an artificial neural networkbased posture identification process and a state-based system to map identified postures onto a set of performanceprocesses. The paper is closed with qualitative usage observations and a projection of future plans.},
 address = {Oslo, Norway},
 author = {Mitchell, Thomas and Heap, Imogen},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178111},
 issn = {2220-4806},
 keywords = {Music Controller, Gestural Music, Data Glove, Neural Network, Live Music Composition, Looping, Imogen Heap },
 pages = {465--468},
 title = {SoundGrasp : A Gestural Interface for the Performance of Live Music},
 url = {http://www.nime.org/proceedings/2011/nime2011_465.pdf},
 year = {2011}
}