Probabilistic Models for Designing Motion and Sound Relationships

Jules Françoise, Norbert Schnell, Riccardo Borghesi, and Frédéric Bevilacqua

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

We present a set of probabilistic models that support the design of movement and sound relationships in interactive sonic systems. We focus on a mapping--by--demonstration approach in which the relationships between motion and sound are defined by a machine learning model that learns from a set of user examples. We describe four probabilistic models with complementary characteristics in terms of multimodality and temporality. We illustrate the practical use of each of the four models with a prototype application for sound control built using our Max implementation.

Citation:

Jules Françoise, Norbert Schnell, Riccardo Borghesi, and Frédéric Bevilacqua. 2014. Probabilistic Models for Designing Motion and Sound Relationships. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178764

BibTeX Entry:

  @inproceedings{jfrancoise12014,
 abstract = {We present a set of probabilistic models that support the design of movement and sound relationships in interactive sonic systems. We focus on a mapping--by--demonstration approach in which the relationships between motion and sound are defined by a machine learning model that learns from a set of user examples. We describe four probabilistic models with complementary characteristics in terms of multimodality and temporality. We illustrate the practical use of each of the four models with a prototype application for sound control built using our Max implementation.},
 address = {London, United Kingdom},
 author = {Jules Fran\c{c}oise and Norbert Schnell and Riccardo Borghesi and Fr\'ed\'eric Bevilacqua},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178764},
 issn = {2220-4806},
 month = {June},
 pages = {287--292},
 publisher = {Goldsmiths, University of London},
 title = {Probabilistic Models for Designing Motion and Sound Relationships},
 url = {http://www.nime.org/proceedings/2014/nime2014_482.pdf},
 year = {2014}
}