Exploring the Impact of Spatial Awareness on Large-Scale AR DMIs

Qiance Zhou, and Charles Martin

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Large-scale Digital Musical Instruments (DMIs) offer immersive performance experiences and rich forms of expression, but often pose physical challenges and limit accessibility. The size of traditional large-scale DMIs limits the ability of performers to interact with the instrument, causing discomfort when engaging with distant components, highlighting the need for more flexible and user-friendly large-scale DMI designs. We present an Augmented Reality (AR) DMI that removes physical constraints by allowing performers to customise the size and layout of the instrument according to their performance environment. We aim to show how AR-based configuration supports immersive performance, promotes expressive gestures, and improves spatial awareness without sacrificing large-scale instrument capabilities. Our user study revealed increased physical engagement and spatial immersion, a strong sense of ownership, and a positive user experience. These findings indicate that our AR DMI is creatively empowering, reasonably addressing the constraints of large-scale instruments. Our research emphasises the potential of AR to enable flexible and customisable DMI design where interfaces can be adapted to suit the needs of individual performers.

Citation

Qiance Zhou, and Charles Martin. 2025. Exploring the Impact of Spatial Awareness on Large-Scale AR DMIs. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.15698972 [PDF]

BibTeX Entry

@article{nime2025_87,
 abstract = {Large-scale Digital Musical Instruments (DMIs) offer immersive performance experiences and rich forms of expression, but often pose physical challenges and limit accessibility. The size of traditional large-scale DMIs limits the ability of performers to interact with the instrument, causing discomfort when engaging with distant components, highlighting the need for more flexible and user-friendly large-scale DMI designs. We present an Augmented Reality (AR) DMI that removes physical constraints by allowing performers to customise the size and layout of the instrument according to their performance environment. We aim to show how AR-based configuration supports immersive performance, promotes expressive gestures, and improves spatial awareness without sacrificing large-scale instrument capabilities. Our user study revealed increased physical engagement and spatial immersion, a strong sense of ownership, and a positive user experience. These findings indicate that our AR DMI is creatively empowering, reasonably addressing the constraints of large-scale instruments. Our research emphasises the potential of AR to enable flexible and customisable DMI design where interfaces can be adapted to suit the needs of individual performers.},
 address = {Canberra, Australia},
 articleno = {87},
 author = {Qiance Zhou and Charles Martin},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.15698972},
 editor = {Doga Cavdir and Florent Berthaut},
 issn = {2220-4806},
 month = {June},
 numpages = {7},
 pages = {594--600},
 title = {Exploring the Impact of Spatial Awareness on Large-Scale AR DMIs},
 track = {Paper},
 url = {http://nime.org/proceedings/2025/nime2025_87.pdf},
 year = {2025}
}