Reach: a keyboard-based gesture recognition system for live piano sound modulation

Niccolò Granieri, and James Dooley

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper presents Reach, a keyboard-based gesture recog- nition system for live piano sound modulation. Reach is a system built using the Leap Motion Orion SDK, Pure Data and a custom C++ OSC mapper1. It provides control over the sound modulation of an acoustic piano using the pi- anist's ancillary gestures. The system was developed using an iterative design pro- cess, incorporating research findings from two user studies and several case studies. The results that emerged show the potential of recognising and utilising the pianist's existing technique when designing keyboard-based DMIs, reducing the requirement to learn additional techniques.

Citation

Niccolò Granieri, and James Dooley. 2019. Reach: a keyboard-based gesture recognition system for live piano sound modulation. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.3673000

BibTeX Entry

@inproceedings{Granieri2019,
 abstract = {This paper presents Reach, a keyboard-based gesture recog- nition system for live piano sound modulation. Reach is a system built using the Leap Motion Orion SDK, Pure Data and a custom C++ OSC mapper1. It provides control over the sound modulation of an acoustic piano using the pi- anist's ancillary gestures. The system was developed using an iterative design pro- cess, incorporating research findings from two user studies and several case studies. The results that emerged show the potential of recognising and utilising the pianist's existing technique when designing keyboard-based DMIs, reducing the requirement to learn additional techniques.},
 address = {Porto Alegre, Brazil},
 author = {Niccolò Granieri and James Dooley},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.3673000},
 editor = {Marcelo Queiroz and Anna Xambó Sedó},
 issn = {2220-4806},
 month = {June},
 pages = {375--376},
 publisher = {UFRGS},
 title = {Reach: a keyboard-based gesture recognition system for live piano sound modulation},
 url = {http://www.nime.org/proceedings/2019/nime2019_paper072.pdf},
 year = {2019}
}