Feeling Connected: Designing Instruments and Haptic Feedback for Collaborative Music Exhibits

Paul Preuschoff, Karl Deilmann, Lea Schirp, and Jan Borchers

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Walk-up music exhibits promise inclusive, social music-making, yet ad-hoc groups of novices often struggle to understand agency, coordinate timing, and stay aware of one another. To address this, we created an interactive exhibit for three visitors that features partially abstract instruments with distinct roles (Drums, Keys, and Bellow-Pipe) and multimodal feedback coupling audio with vibrotactile cues via floor plates and instrument-mounted actuators. Following a Research Through Design process, we conducted a participatory design workshop (n=7) that led to one of the instruments using a wind-instrument-inspired interface. A subsequent user study (n=21) of our refined system compared three haptic feedback modes during backing-track performances: a metronomic floor pulse, individual action feedback, and combined action feedback that merged co-players' signals. Using observations, questionnaires, and reflexive thematic analysis of interviews, we found that groups transitioned rapidly from self-focused exploration to coordinated call-and-response play, reporting high levels of enjoyment and largely balanced participation. While participants consistently noticed the shared beat, perceived awareness of co-players increased over time. Haptic support was experienced as both guidance and potential overload: the metronomic pulse was seen as most helpful, whereas global feedback could increase group awareness but blur source separation. We discuss design implications for similar exhibits, highlighting trade-offs between scaffolding and freedom, individual clarity and group awareness, and feedback richness and perceptual load.

Citation

Paul Preuschoff, Karl Deilmann, Lea Schirp, and Jan Borchers. 2026. Feeling Connected: Designing Instruments and Haptic Feedback for Collaborative Music Exhibits. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.20784421 [PDF]

BibTeX Entry

@inproceedings{nime2026_138,
 abstract = {Walk-up music exhibits promise inclusive, social music-making, yet ad-hoc groups of novices often struggle to understand agency, coordinate timing, and stay aware of one another. To address this, we created an interactive exhibit for three visitors that features partially abstract instruments with distinct roles (Drums, Keys, and Bellow-Pipe) and multimodal feedback coupling audio with vibrotactile cues via floor plates and instrument-mounted actuators. Following a Research Through Design process, we conducted a participatory design workshop (n=7) that led to one of the instruments using a wind-instrument-inspired interface. A subsequent user study (n=21) of our refined system compared three haptic feedback modes during backing-track performances: a metronomic floor pulse, individual action feedback, and combined action feedback that merged co-players' signals. Using observations, questionnaires, and reflexive thematic analysis of interviews, we found that groups transitioned rapidly from self-focused exploration to coordinated call-and-response play, reporting high levels of enjoyment and largely balanced participation. While participants consistently noticed the shared beat, perceived awareness of co-players increased over time. Haptic support was experienced as both guidance and potential overload: the metronomic pulse was seen as most helpful, whereas global feedback could increase group awareness but blur source separation. We discuss design implications for similar exhibits, highlighting trade-offs between scaffolding and freedom, individual clarity and group awareness, and feedback richness and perceptual load.},
 address = {London, United Kingdom},
 articleno = {138},
 author = {Paul Preuschoff and Karl Deilmann and Lea Schirp and Jan Borchers},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.20784421},
 editor = {Benedict Gaster and João Tragtenberg and Anna Xambó and Tom Mitchell},
 issn = {2220-4806},
 month = {June},
 note = {},
 numpages = {9},
 pages = {1128--1136},
 presentation-video = {https://youtu.be/uAaOAdw4naw},
 title = {Feeling Connected: Designing Instruments and Haptic Feedback for Collaborative Music Exhibits},
 track = {paper},
 url = {http://nime.org/proceedings/2026/nime2026_138.pdf},
 year = {2026}
}