3DinMotion A Mocap Based Interface for Real Time Visualisation and Sonification of Multi-User Interactions

Alain Renaud, Caecilia Charbonnier, and Sylvain Chagué

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper provides an overview of a proposed demonstration of 3DinMotion, a system using real time motion capture of one or several subjects, which can be used in interactive audiovisual pieces and network performances. The skeleton of a subject is analyzed in real time and displayed as an abstract avatar as well as sonified based on mappings and rules to make the interplay experience lively and rewarding. A series of musical pieces have been composed for the interface following cueing strategies. In addition a second display, ``the prompter'' guides the users through the piece. 3DinMotion has been developed from scratch and natively, leading to a system with a very low latency, making it suitable for real time music interactions. In addition, 3DinMotion is fully compatible with the OpenSoundControl (OSC) protocol, allowing expansion to commonly used musical and sound design applications.

Citation:

Alain Renaud, Caecilia Charbonnier, and Sylvain Chagué. 2014. 3DinMotion A Mocap Based Interface for Real Time Visualisation and Sonification of Multi-User Interactions. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178915

BibTeX Entry:

  @inproceedings{arenaud2014,
 abstract = {This paper provides an overview of a proposed demonstration of 3DinMotion, a system using real time motion capture of one or several subjects, which can be used in interactive audiovisual pieces and network performances. The skeleton of a subject is analyzed in real time and displayed as an abstract avatar as well as sonified based on mappings and rules to make the interplay experience lively and rewarding. A series of musical pieces have been composed for the interface following cueing strategies. In addition a second display, ``the prompter'' guides the users through the piece. 3DinMotion has been developed from scratch and natively, leading to a system with a very low latency, making it suitable for real time music interactions. In addition, 3DinMotion is fully compatible with the OpenSoundControl (OSC) protocol, allowing expansion to commonly used musical and sound design applications.},
 address = {London, United Kingdom},
 author = {Alain Renaud and Caecilia Charbonnier and Sylvain Chagu\'e},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178915},
 issn = {2220-4806},
 month = {June},
 pages = {495--496},
 publisher = {Goldsmiths, University of London},
 title = {{3D}inMotion A Mocap Based Interface for Real Time Visualisation and Sonification of Multi-User Interactions},
 url = {http://www.nime.org/proceedings/2014/nime2014_423.pdf},
 year = {2014}
}