Peripersonal Modular Interfaces for Care Ecologies: Decoupling Sensing and Surface in Accessible Digital Musical Instruments

Wing Hei Cheryl Hui, and Patrick Hartono

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Accessible Digital Musical Instruments (ADMIs) are often assessed for individual access, yet community workshops depend on facilitation labour, hygiene, rapid setup, and shared authorship. We report a collaboration with a London-based community music charity to co-design a Peripersonal Modular Interface that supports ensemble music-making across diverse motor profiles. The system comprises wireless sensing tiles with TPU lattice structures, mechanically decoupling non-contact Hall-effect sensing from the deformable surface so compliance can be tuned without compromising robustness or cleaning. Treating each tile as an independent network node enables participants and facilitators to reconfigure the instrument across tabletops, wheelchair trays, or floors and to negotiate "where the instrument is" in situ within a care ecology. We present findings from a co-design study (N=12) spanning musicians, facilitators, support workers, and volunteers, alongside end-to-end latency benchmarking of a private haptic–audio loop. Results show ~7 ms average latency (max <12ms) and reports of immediate sonic response, cable-free safety, and maintainability via replaceable tactile layers, exemplifying structural agency beyond screen-based administration.

Citation

Wing Hei Cheryl Hui, and Patrick Hartono. 2026. Peripersonal Modular Interfaces for Care Ecologies: Decoupling Sensing and Surface in Accessible Digital Musical Instruments. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.20784439 [PDF]

BibTeX Entry

@inproceedings{nime2026_145,
 abstract = {Accessible Digital Musical Instruments (ADMIs) are often assessed for individual access, yet community workshops depend on facilitation labour, hygiene, rapid setup, and shared authorship. We report a collaboration with a London-based community music charity to co-design a Peripersonal Modular Interface that supports ensemble music-making across diverse motor profiles. The system comprises wireless sensing tiles with TPU lattice structures, mechanically decoupling non-contact Hall-effect sensing from the deformable surface so compliance can be tuned without compromising robustness or cleaning. Treating each tile as an independent network node enables participants and facilitators to reconfigure the instrument across tabletops, wheelchair trays, or floors and to negotiate "where the instrument is" in situ within a care ecology. We present findings from a co-design study (N=12) spanning musicians, facilitators, support workers, and volunteers, alongside end-to-end latency benchmarking of a private haptic–audio loop. Results show ~7 ms average latency (max <12ms) and reports of immediate sonic response, cable-free safety, and maintainability via replaceable tactile layers, exemplifying structural agency beyond screen-based administration.},
 address = {London, United Kingdom},
 articleno = {145},
 author = {Wing Hei Cheryl Hui and Patrick Hartono},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.20784439},
 editor = {Benedict Gaster and João Tragtenberg and Anna Xambó and Tom Mitchell},
 issn = {2220-4806},
 month = {June},
 note = {},
 numpages = {10},
 pages = {1180--1189},
 presentation-video = {https://youtu.be/RflHrpro-W4},
 title = {Peripersonal Modular Interfaces for Care Ecologies: Decoupling Sensing and Surface in Accessible Digital Musical Instruments},
 track = {paper},
 url = {http://nime.org/proceedings/2026/nime2026_145.pdf},
 year = {2026}
}