Nuvolet: 3D Gesture-driven Collaborative Audio Mosaicing

Josep M. Comajuncosas, Alex Barrachina, John O'Connell, and Enric Guaus

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This research presents a 3D gestural interface for collaborative concatenative sound synthesis and audio mosaicing.Our goal is to improve the communication between the audience and performers by means of an enhanced correlationbetween gestures and musical outcome. Nuvolet consists ofa 3D motion controller coupled to a concatenative synthesis engine. The interface detects and tracks the performers hands in four dimensions (x,y,z,t) and allows them toconcurrently explore two or three-dimensional sound cloudrepresentations of the units from the sound corpus, as wellas to perform collaborative target-based audio mosaicing.Nuvolet is included in the Esmuc Laptop Orchestra catalogfor forthcoming performances.

Citation:

Josep M. Comajuncosas, Alex Barrachina, John O'Connell, and Enric Guaus. 2011. Nuvolet: 3D Gesture-driven Collaborative Audio Mosaicing. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177987

BibTeX Entry:

  @inproceedings{Comajuncosas2011,
 abstract = {This research presents a 3D gestural interface for collaborative concatenative sound synthesis and audio mosaicing.Our goal is to improve the communication between the audience and performers by means of an enhanced correlationbetween gestures and musical outcome. Nuvolet consists ofa 3D motion controller coupled to a concatenative synthesis engine. The interface detects and tracks the performers hands in four dimensions (x,y,z,t) and allows them toconcurrently explore two or three-dimensional sound cloudrepresentations of the units from the sound corpus, as wellas to perform collaborative target-based audio mosaicing.Nuvolet is included in the Esmuc Laptop Orchestra catalogfor forthcoming performances.},
 address = {Oslo, Norway},
 author = {Comajuncosas, Josep M. and Barrachina, Alex and O'Connell, John and Guaus, Enric},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177987},
 issn = {2220-4806},
 keywords = {concatenative synthesis, audio mosaicing, open-air interface, gestural controller, musical instrument, 3D },
 pages = {252--255},
 title = {Nuvolet: {3D} Gesture-driven Collaborative Audio Mosaicing},
 url = {http://www.nime.org/proceedings/2011/nime2011_252.pdf},
 year = {2011}
}