From Control to Co-Agency: Reframing Instrumentality through Sonic Traces in Augmented Musical Practice

Mercedes Krapovickas, and Jan Schacher

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Contemporary practices with augmented and digitally mediated musical instruments increasingly question familiar ideas of control, mastery, and instrumental agency. In many such practices, agency is distributed across bodies, technical configurations, spaces, and temporal processes, reorienting instrumental design toward shared agency rather than a primary focus on parameter extension or mapping within a constrained digital domain. From this perspective, musical instruments can be understood less as interfaces to be controlled and more as entwined systems, i.e. relational ecologies shaped through listening, bodily awareness, and adaptive (inter-)action. Grounded in artistic practice, this paper explores how subtle, non-dominant sonic phenomena can function as meaningful resources for interaction with an augmented acoustic instrument. Focusing on a solo bandoneon augmented through live electronics and machine learning, the work articulates the three interrelated concepts of peripheral sounds, gestural remains, and sonic leakage that become perceptible through practice, amplification, and learning. Sounds arising from the instrument’s materials, friction with the body and lingering resonances, are approached not as side effects, but as sonic traces that orient listening and action. Across the design and composition of a live-electronic ecosystem, a concert performance, and a performative sound installation, these subtle sounds operate as cues for action, shaping movement, timing, and decision-making for both performer and technical system. Attending to such phenomena leads to new gestural strategies, alternative modes of augmentation, and shifts in how listening is organised within performance situations. By reconsidering what counts as signal in augmented instruments that use machine-learning, this work contributes to NIME discussions on affordances, agency, and relational instrument design, foregrounding co-agency grounded in responsiveness and emergent behaviour.

Citation

Mercedes Krapovickas, and Jan Schacher. 2026. From Control to Co-Agency: Reframing Instrumentality through Sonic Traces in Augmented Musical Practice. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.20784362 [PDF]

BibTeX Entry


@inproceedings{nime2026_116,
abstract = {Contemporary practices with augmented and digitally mediated musical instruments increasingly question familiar ideas of control, mastery, and instrumental agency. In many such practices, agency is distributed across bodies, technical configurations, spaces, and temporal processes, reorienting instrumental design toward shared agency rather than a primary focus on parameter extension or mapping within a constrained digital domain. From this perspective, musical instruments can be understood less as interfaces to be controlled and more as entwined systems, i.e. relational ecologies shaped through listening, bodily awareness, and adaptive (inter-)action. Grounded in artistic practice, this paper explores how subtle, non-dominant sonic phenomena can function as meaningful resources for interaction with an augmented acoustic instrument. Focusing on a solo bandoneon augmented through live electronics and machine learning, the work articulates the three interrelated concepts of peripheral sounds, gestural remains, and sonic leakage that become perceptible through practice, amplification, and  learning. Sounds arising from the instrument’s materials, friction with the body and lingering resonances, are approached not as side effects, but as sonic traces that orient listening and action. Across the design and composition of a live-electronic ecosystem, a concert performance, and a performative sound installation, these subtle sounds operate as cues for action, shaping movement, timing, and decision-making for both performer and technical system. Attending to such phenomena leads to new gestural strategies, alternative modes of augmentation, and shifts in how listening is organised within performance situations. By reconsidering what counts as signal in augmented instruments that use machine-learning, this work contributes to NIME discussions on affordances, agency, and relational instrument design, foregrounding co-agency grounded in responsiveness and emergent behaviour.},
address = {London, United Kingdom},
articleno = {116},
author = {Mercedes Krapovickas and Jan Schacher},
booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
doi = {10.5281/zenodo.20784362},
editor = {Benedict Gaster and João Tragtenberg and Anna Xambó and Tom Mitchell},
issn = {2220-4806},
month = {June},
numpages = {9},
pages = {957--965},
title = {From Control to Co-Agency: Reframing Instrumentality through Sonic Traces in Augmented Musical Practice},
track = {paper},
url = {http://nime.org/proceedings/2026/nime2026_116.pdf},
year = {2026}
}