Gestural Embodiment of Environmental Sounds: an Experimental Study

Baptiste Caramiaux, Patrick Susini, Tommaso Bianco, Frédéric Bevilacqua, Olivier Houix, Norbert Schnell, and Nicolas Misdariis

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper we present an experimental study concerninggestural embodiment of environmental sounds in a listeningcontext. The presented work is part of a project aiming atmodeling movement-sound relationships, with the end goalof proposing novel approaches for designing musical instruments and sounding objects. The experiment is based onsound stimuli corresponding to "causal" and "non-causal" sounds. It is divided into a performance phase and an interview. The experiment is designed to investigate possiblecorrelation between the perception of the "causality" of environmental sounds and different gesture strategies for thesound embodiment. In analogy with the perception of thesounds' causality, we propose to distinguish gestures that "mimic" a sound's cause and gestures that "trace" a sound'smorphology following temporal sound characteristics. Results from the interviews show that, first, our causal soundsdatabase lead to consistent descriptions of the action at theorigin of the sound and participants mimic this action. Second, non-causal sounds lead to inconsistent metaphoric descriptions of the sound and participants make gestures following sound "contours". Quantitatively, the results showthat gesture variability is higher for causal sounds that noncausal sounds.

Citation:

Baptiste Caramiaux, Patrick Susini, Tommaso Bianco, Frédéric Bevilacqua, Olivier Houix, Norbert Schnell, and Nicolas Misdariis. 2011. Gestural Embodiment of Environmental Sounds: an Experimental Study. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177979

BibTeX Entry:

  @inproceedings{Caramiaux2011a,
 abstract = {In this paper we present an experimental study concerninggestural embodiment of environmental sounds in a listeningcontext. The presented work is part of a project aiming atmodeling movement-sound relationships, with the end goalof proposing novel approaches for designing musical instruments and sounding objects. The experiment is based onsound stimuli corresponding to "causal" and "non-causal" sounds. It is divided into a performance phase and an interview. The experiment is designed to investigate possiblecorrelation between the perception of the "causality" of environmental sounds and different gesture strategies for thesound embodiment. In analogy with the perception of thesounds' causality, we propose to distinguish gestures that "mimic" a sound's cause and gestures that "trace" a sound'smorphology following temporal sound characteristics. Results from the interviews show that, first, our causal soundsdatabase lead to consistent descriptions of the action at theorigin of the sound and participants mimic this action. Second, non-causal sounds lead to inconsistent metaphoric descriptions of the sound and participants make gestures following sound "contours". Quantitatively, the results showthat gesture variability is higher for causal sounds that noncausal sounds.},
 address = {Oslo, Norway},
 author = {Caramiaux, Baptiste and Susini, Patrick and Bianco, Tommaso and Bevilacqua, Fr\'{e}d\'{e}ric and Houix, Olivier and Schnell, Norbert and Misdariis, Nicolas},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177979},
 issn = {2220-4806},
 keywords = {Embodiment, Environmental Sound Perception, Listening, Gesture Sound Interaction },
 pages = {144--148},
 presentation-video = {https://vimeo.com/26805553/},
 title = {Gestural Embodiment of Environmental Sounds: an Experimental Study},
 url = {http://www.nime.org/proceedings/2011/nime2011_144.pdf},
 year = {2011}
}