PathoSonic: Performing Sound In Virtual Reality Feature Space

Fede Camara Halac, and Shadrick Addy

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

PathoSonic is a VR experience that enables a participant to visualize and perform a sound file based on timbre feature descriptors displayed in space. The name comes from the different paths the participant can create through their sonic explorations. The goal of this research is to leverage affordances of virtual reality technology to visualize sound through different levels of performance-based interactivity that immerses the participant's body in a spatial virtual environment. Through implementation of a multi-sensory experience, including visual aesthetics, sound, and haptic feedback, we explore inclusive approaches to sound visualization, making it more accessible to a wider audience including those with hearing, and mobility impairments. The online version of the paper can be accessed here: https://fdch.github.io/pathosonic

Citation:

Fede Camara Halac, and Shadrick Addy. 2020. PathoSonic: Performing Sound In Virtual Reality Feature Space. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.4813510

BibTeX Entry:

  @inproceedings{NIME20_99,
 abstract = {PathoSonic is a VR experience that enables a participant to visualize and perform a sound file based on timbre feature descriptors displayed in space. The name comes from the different paths the participant can create through their sonic explorations. The goal of this research is to leverage affordances of virtual reality technology to visualize sound through different levels of performance-based interactivity that immerses the participant's body in a spatial virtual environment. Through implementation of a multi-sensory experience, including visual aesthetics, sound, and haptic feedback, we explore inclusive approaches to sound visualization, making it more accessible to a wider audience including those with hearing, and mobility impairments. The online version of the paper can be accessed here: https://fdch.github.io/pathosonic},
 address = {Birmingham, UK},
 author = {Camara Halac, Fede and Addy, Shadrick},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.4813510},
 editor = {Romain Michon and Franziska Schroeder},
 issn = {2220-4806},
 month = {July},
 pages = {520--522},
 publisher = {Birmingham City University},
 title = {PathoSonic: Performing Sound In Virtual Reality Feature Space},
 url = {https://www.nime.org/proceedings/2020/nime2020_paper99.pdf},
 year = {2020}
}