The Gesturally Extended Piano

William Brent

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper introduces the Gesturally Extended Piano---an augmented instrument controller that relies on information drawn from performer motion tracking in order to control real-time audiovisual processing and synthesis. Specifically, the positions, heights, velocities, and relative distances and angles of points on the hands and forearms are followed. Technical details and installation of the tracking system are covered, as well as strategies for interpreting and mapping the resulting data in relation to synthesis parameters. Design factors surrounding mapping choices and the interrelation between mapped parameters are also considered.

Citation:

William Brent. 2012. The Gesturally Extended Piano. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178219

BibTeX Entry:

  @inproceedings{Brent2012,
 abstract = {This paper introduces the Gesturally Extended Piano---an augmented instrument controller that relies on information drawn from performer motion tracking in order to control real-time audiovisual processing and synthesis. Specifically, the positions, heights, velocities, and relative distances and angles of points on the hands and forearms are followed. Technical details and installation of the tracking system are covered, as well as strategies for interpreting and mapping the resulting data in relation to synthesis parameters. Design factors surrounding mapping choices and the interrelation between mapped parameters are also considered.},
 address = {Ann Arbor, Michigan},
 author = {William Brent},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178219},
 issn = {2220-4806},
 keywords = {Augmented instruments, controllers, motion tracking, mapping},
 publisher = {University of Michigan},
 title = {The Gesturally Extended Piano},
 url = {http://www.nime.org/proceedings/2012/nime2012_102.pdf},
 year = {2012}
}