Sonic Structures: 4E Visual Sound in Multi-User Mixed Reality

Krishnan Chandran, Lars Engeln, Daniel Zeidler, and Matthew McGinity

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Sonic Structures is a multi-user mixed reality experiment that explores the relationship between visual form and sound and music creation through the lens of 4E (embodied, enactive, embedded and extended) cognition. By extending a custom platform allowing large scale mixed reality experiences for up to 20 users with real-time audio processing and generative 3D graphics, Sonic Structures provides a sandbox environment for the real-time transformation of sound and music into persistent visual structures. Described here is the conceptual and architectural design of the project and the results of a workshop exploring the musical, educational and artistic potential of the system.

Citation

Krishnan Chandran, Lars Engeln, Daniel Zeidler, and Matthew McGinity. 2024. Sonic Structures: 4E Visual Sound in Multi-User Mixed Reality. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.13904897

BibTeX Entry

@article{nime2024_61,
 abstract = {Sonic Structures is a multi-user mixed reality experiment that explores the relationship between visual form and sound and music creation through the lens of 4E (embodied, enactive, embedded and extended) cognition. By extending a custom platform allowing large scale mixed reality experiences for up to 20 users with real-time audio processing and generative 3D graphics, Sonic Structures provides a sandbox environment for the real-time transformation of sound and music into persistent visual structures. Described here is the conceptual and architectural design of the project and the results of a workshop exploring the musical, educational and artistic potential of the system.},
 address = {Utrecht, Netherlands},
 articleno = {61},
 author = {Krishnan Chandran and Lars Engeln and Daniel Zeidler and Matthew McGinity},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.13904897},
 editor = {S M Astrid Bin and Courtney N. Reed},
 issn = {2220-4806},
 month = {September},
 numpages = {5},
 pages = {419--423},
 title = {Sonic Structures: 4E Visual Sound in Multi-User Mixed Reality},
 track = {Papers},
 url = {http://nime.org/proceedings/2024/nime2024_61.pdf},
 year = {2024}
}