VR-RoBoser : Real-Time Adaptive Sonification of Virtual Environments Based on Avatar Behavior

Sylvain le Groux, Jonatas Manzolli, and Paul F. Verschure

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2007
• Location: New York City, NY, United States
• Pages: 371–374
• Keywords: Real-time Composition, Interactive Sonification, Real-time Neural Processing, Multimedia, Virtual Environment, Avatar.
• DOI: 10.5281/zenodo.1177101 (Link to paper)
• PDF link

Abstract:

Until recently, the sonification of Virtual Environments had often been reduced to its simplest expression. Too often soundscapes and background music are predetermined, repetitive and somewhat predictable. Yet, there is room for more complex and interesting sonification schemes that can improve the sensation of presence in a Virtual Environment. In this paper we propose a system that automatically generates original background music in real-time called VR-RoBoser. As a test case we present the application of VR-RoBoser to a dynamic avatar that explores its environment. We show that the musical events are directly and continuously generated and influenced by the behavior of the avatar in three-dimensional virtual space, generating a context dependent sonification.

Citation:

BibTeX Entry:

  @inproceedings{Groux2007,
 abstract = {Until recently, the sonification of Virtual Environments had often been reduced to its simplest expression. Too often soundscapes and background music are predetermined, repetitive and somewhat predictable. Yet, there is room for more complex and interesting sonification schemes that can improve the sensation of presence in a Virtual Environment. In this paper we propose a system that automatically generates original background music in real-time called VR-RoBoser. As a test case we present the application of VR-RoBoser to a dynamic avatar that explores its environment. We show that the musical events are directly and continuously generated and influenced by the behavior of the avatar in three-dimensional virtual space, generating a context dependent sonification. },
 address = {New York City, NY, United States},
 author = {le Groux, Sylvain and Manzolli, Jonatas and Verschure, Paul F.},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177101},
 issn = {2220-4806},
 keywords = {Real-time Composition, Interactive Sonification, Real-time Neural Processing, Multimedia, Virtual Environment, Avatar. },
 pages = {371--374},
 title = {VR-RoBoser : Real-Time Adaptive Sonification of Virtual Environments Based on Avatar Behavior},
 url = {http://www.nime.org/proceedings/2007/nime2007_371.pdf},
 year = {2007}
}