Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience

Florent Berthaut, Mark T. Marshall, Sriram Subramanian, and Martin Hachet

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Digital musical instruments bring new possibilities for musical performance.They are also more complex for the audience to understand, due to the diversityof their components and the magical aspect of the musicians' actions whencompared to acoustic instruments. This complexity results in a loss of livenessand possibly a poor experience for the audience. Our approach, called Rouages,is based on a mixed-reality display system and a 3D visualization application.It reveals the mechanisms of digital musical instruments by amplifyingmusicians' gestures with virtual extensions of the sensors, by representingthe sound components with 3D shapes and specific behaviors and by showing theimpact ofmusicians gestures on these components. We believe that Rouages opens up newperspectives to help instrument makers and musicians improve audienceexperience with their digital musical instruments.

Citation:

Florent Berthaut, Mark T. Marshall, Sriram Subramanian, and Martin Hachet. 2013. Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178478

BibTeX Entry:

  @inproceedings{Berthaut2013,
 abstract = {Digital musical instruments bring new possibilities for musical performance.They are also more complex for the audience to understand, due to the diversityof their components and the magical aspect of the musicians' actions whencompared to acoustic instruments. This complexity results in a loss of livenessand possibly a poor experience for the audience. Our approach, called Rouages,is based on a mixed-reality display system and a 3D visualization application.It reveals the mechanisms of digital musical instruments by amplifyingmusicians' gestures with virtual extensions of the sensors, by representingthe sound components with 3D shapes and specific behaviors and by showing theimpact ofmusicians gestures on these components. We believe that Rouages opens up newperspectives to help instrument makers and musicians improve audienceexperience with their digital musical instruments.},
 address = {Daejeon, Republic of Korea},
 author = {Florent Berthaut and Mark T. Marshall and Sriram Subramanian and Martin Hachet},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178478},
 issn = {2220-4806},
 keywords = {rouages, digital musical instruments, mappings, 3D interface, mixed-reality,},
 month = {May},
 pages = {164--169},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Rouages: Revealing the Mechanisms of Digital Musical Instruments to the Audience},
 url = {http://www.nime.org/proceedings/2013/nime2013_51.pdf},
 year = {2013}
}