Expressive Control of Music and Visual Media by Full-Body Movement

Ginevra Castellano, Roberto Bresin, Antonio Camurri, and Gualtiero Volpe

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper we describe a system which allows users to use their full-body for controlling in real-time the generation of an expressive audio-visual feedback. The system extracts expressive motion features from the user's full-body movements and gestures. The values of these motion features are mapped both onto acoustic parameters for the real-time expressive rendering of a piece of music, and onto real-time generated visual feedback projected on a screen in front of the user.

Citation:

Ginevra Castellano, Roberto Bresin, Antonio Camurri, and Gualtiero Volpe. 2007. Expressive Control of Music and Visual Media by Full-Body Movement. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177065

BibTeX Entry:

  @inproceedings{Castellano2007,
 abstract = {In this paper we describe a system which allows users to use their full-body for controlling in real-time the generation of an expressive audio-visual feedback. The system extracts expressive motion features from the user's full-body movements and gestures. The values of these motion features are mapped both onto acoustic parameters for the real-time expressive rendering of a piece of music, and onto real-time generated visual feedback projected on a screen in front of the user. },
 address = {New York City, NY, United States},
 author = {Castellano, Ginevra and Bresin, Roberto and Camurri, Antonio and Volpe, Gualtiero},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177065},
 issn = {2220-4806},
 keywords = {Expressive interaction; multimodal environments; interactive music systems },
 pages = {390--391},
 title = {Expressive Control of Music and Visual Media by Full-Body Movement},
 url = {http://www.nime.org/proceedings/2007/nime2007_390.pdf},
 year = {2007}
}