AirPiano: A Multi-Touch Keyboard with Hovering Control

Nicolas d'Alessandro, Joëlle Tilmanne, Ambroise Moreau, and Antonin Puleo

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2015
• Location: Baton Rouge, Louisiana, USA
• Pages: 255–258
• DOI: 10.5281/zenodo.1181434 (Link to paper)
• PDF link

Abstract:

In this paper, we describe the prototyping of two musical interfaces that use the LeapMotion camera in conjunction with two different touch surfaces: a Wacom tablet and a transparent PVC sheet. In the Wacom use case, the camera is between the hand and the surface. In the PVC use case, the camera is under the transparent sheet and tracks the hand through it. The aim of this research is to explore hovering motion surrounding the touch interaction on the surface and include properties of such motion in the musical interaction. We present our unifying software, called AirPiano, that discretises the 3D space into 'keys' and proposes several mapping strategies with the available dimensions. These control dimensions are mapped onto a modified HandSketch sound engine that achieves multitimbral pitch-synchronous point cloud granulation.

Citation:

BibTeX Entry:

  @inproceedings{ndalessandro2015,
 abstract = {In this paper, we describe the prototyping of two musical interfaces that use the LeapMotion camera in conjunction with two different touch surfaces: a Wacom tablet and a transparent PVC sheet. In the Wacom use case, the camera is between the hand and the surface. In the PVC use case, the camera is under the transparent sheet and tracks the hand through it. The aim of this research is to explore hovering motion surrounding the touch interaction on the surface and include properties of such motion in the musical interaction. We present our unifying software, called AirPiano, that discretises the 3D space into 'keys' and proposes several mapping strategies with the available dimensions. These control dimensions are mapped onto a modified HandSketch sound engine that achieves multitimbral pitch-synchronous point cloud granulation.},
 address = {Baton Rouge, Louisiana, USA},
 author = {Nicolas d'Alessandro and Jo\''elle Tilmanne and Ambroise Moreau and Antonin Puleo},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1181434},
 editor = {Edgar Berdahl and Jesse Allison},
 issn = {2220-4806},
 month = {May},
 pages = {255--258},
 publisher = {Louisiana State University},
 title = {AirPiano: A Multi-Touch Keyboard with Hovering Control},
 url = {http://www.nime.org/proceedings/2015/nime2015_261.pdf},
 year = {2015}
}