The Composing Hand: Musical Creation with Leap Motion and the BigBang Rubette

Daniel Tormoen, Florian Thalmann, and Guerino Mazzola

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper introduces an extension of the Rubato Composer software's BigBang rubette module for gestural composition. The extension enables composers and improvisers to operate BigBang using the Leap Motion controller, which uses two cameras to detect hand motions in three-dimensional space. The low latency and high precision of the device make it a good fit for BigBang's functionality, which is based on immediate visual and auditive feedback. With the new extensions, users can define an infinite variety of musical objects, such as oscillators, pitches, chord progressions, or frequency modulators, in real-time and transform them in order to generate more complex musical structures on any level of abstraction.

Citation:

Daniel Tormoen, Florian Thalmann, and Guerino Mazzola. 2014. The Composing Hand: Musical Creation with Leap Motion and the BigBang Rubette. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178955

BibTeX Entry:

  @inproceedings{fthalmann2014,
 abstract = {This paper introduces an extension of the Rubato Composer software's BigBang rubette module for gestural composition. The extension enables composers and improvisers to operate BigBang using the Leap Motion controller, which uses two cameras to detect hand motions in three-dimensional space. The low latency and high precision of the device make it a good fit for BigBang's functionality, which is based on immediate visual and auditive feedback. With the new extensions, users can define an infinite variety of musical objects, such as oscillators, pitches, chord progressions, or frequency modulators, in real-time and transform them in order to generate more complex musical structures on any level of abstraction.},
 address = {London, United Kingdom},
 author = {Daniel Tormoen and Florian Thalmann and Guerino Mazzola},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178955},
 issn = {2220-4806},
 month = {June},
 pages = {207--212},
 publisher = {Goldsmiths, University of London},
 title = {The Composing Hand: Musical Creation with Leap Motion and the BigBang Rubette},
 url = {http://www.nime.org/proceedings/2014/nime2014_536.pdf},
 year = {2014}
}