Musical Interaction with Hand Posture and Orientation: A Toolbox of Gestural Control Mechanisms

Thomas Mitchell, Sebastian Madgwick, and Imogen Heap

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper presents a toolbox of gestural control mechanisms which are available when the input sensing apparatus is a pair of data gloves fitted with orientation sensors. The toolbox was developed in advance of a live music performance in which the mapping from gestural input to audio output was to be developed rapidly in collaboration with the performer. The paper begins with an introduction to the associated literature before introducing a range of continuous, discrete and combined control mechanisms, enabling a flexible range of mappings to be explored and modified easily. An application of the toolbox within a live music performance is then described with an evaluation of the system with ideas for future developments.

Citation:

Thomas Mitchell, Sebastian Madgwick, and Imogen Heap. 2012. Musical Interaction with Hand Posture and Orientation: A Toolbox of Gestural Control Mechanisms. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1180543

BibTeX Entry:

  @inproceedings{Mitchell2012,
 abstract = {This paper presents a toolbox of gestural control mechanisms which are available when the input sensing apparatus is a pair of data gloves fitted with orientation sensors. The toolbox was developed in advance of a live music performance in which the mapping from gestural input to audio output was to be developed rapidly in collaboration with the performer. The paper begins with an introduction to the associated literature before introducing a range of continuous, discrete and combined control mechanisms, enabling a flexible range of mappings to be explored and modified easily. An application of the toolbox within a live music performance is then described with an evaluation of the system with ideas for future developments.},
 address = {Ann Arbor, Michigan},
 author = {Thomas Mitchell and Sebastian Madgwick and Imogen Heap},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1180543},
 issn = {2220-4806},
 keywords = {Computer Music, Gestural Control, Data Gloves},
 publisher = {University of Michigan},
 title = {Musical Interaction with Hand Posture and Orientation: A Toolbox of Gestural Control Mechanisms},
 url = {http://www.nime.org/proceedings/2012/nime2012_272.pdf},
 year = {2012}
}