Lessons Learned in Exploring the Leap Motion(TM) Sensor for Gesture-based Instrument Design

Jihyun Han, and Nicolas Gold

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The Leap Motion(TM) sensor offers fine-grained gesture-recognition and hand tracking. Since its release, there have been several uses of the device for instrument design, musical interaction and expression control, documented through online video. However, there has been little formal documented investigation of the potential and challenges of the platform in this context. This paper presents lessons learned from work-in-progress on the development of musical instruments and control applications using the Leap Motion(TM) sensor. Two instruments are presented: Air-Keys and Air-Pads and the potential for augmentation of a traditional keyboard is explored. The results show that the platform is promising in this context but requires various challenges, both physical and logical, to be overcome.

Citation:

Jihyun Han, and Nicolas Gold. 2014. Lessons Learned in Exploring the Leap Motion(TM) Sensor for Gesture-based Instrument Design. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178784

BibTeX Entry:

  @inproceedings{ngold2014,
 abstract = {The Leap Motion(TM) sensor offers fine-grained gesture-recognition and hand tracking. Since its release, there have been several uses of the device for instrument design, musical interaction and expression control, documented through online video. However, there has been little formal documented investigation of the potential and challenges of the platform in this context. This paper presents lessons learned from work-in-progress on the development of musical instruments and control applications using the Leap Motion(TM) sensor. Two instruments are presented: Air-Keys and Air-Pads and the potential for augmentation of a traditional keyboard is explored. The results show that the platform is promising in this context but requires various challenges, both physical and logical, to be overcome.},
 address = {London, United Kingdom},
 author = {Jihyun Han and Nicolas Gold},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178784},
 issn = {2220-4806},
 month = {June},
 pages = {371--374},
 publisher = {Goldsmiths, University of London},
 title = {Lessons Learned in Exploring the Leap Motion(TM) Sensor for Gesture-based Instrument Design},
 url = {http://www.nime.org/proceedings/2014/nime2014_485.pdf},
 year = {2014}
}