From Performance to Installation: How Interactive Reinforcement Learning Reframes the Roles of Performers and Audiences

Danny Perreault, Victor Drouin-Trempe, Vincent Cusson, David Drouin, and Sofian Audry

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper explores how interactive reinforcement learning (IRL) reconfigures the roles of performers and audiences in audiovisual performance and immersive installations. We adapt the Co-Explorer (a software tool originally developed for musical co-creation) to audiovisual immersive contexts and examine its creative potential using a reflexive research-creation approach. Our study reveals how IRL splits the role of the performer into three distinct positions: (1) the designer, who defines the parametric space; (2) the guide, who reinforces the agent’s behavior; and (3) the machine performer, whose actions are shaped by interactive training. As IRL introduces agency into the creative process, it transforms traditional notions of authorship and control, enabling unexpected emergent outcomes. By showcasing an interactive installation/performance, we further explore how audiences contribute to collective creation through reinforcement-based interaction. Our findings underscore the challenges of balancing the temporality of IRL with the demands of public-facing works and of adapting RL-based systems to different exhibition contexts. Our work contributes to the discourse on co-creative systems, emphasizing the evolving roles of artists, artificial agents, and audiences in hybrid creative ecosystems.

Citation

Danny Perreault, Victor Drouin-Trempe, Vincent Cusson, David Drouin, and Sofian Audry. 2025. From Performance to Installation: How Interactive Reinforcement Learning Reframes the Roles of Performers and Audiences. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.15698948 [PDF]

BibTeX Entry

@article{nime2025_76,
 abstract = {This paper explores how interactive reinforcement learning (IRL) reconfigures the roles of performers and audiences in audiovisual performance and immersive installations. We adapt the Co-Explorer (a software tool originally developed for musical co-creation) to audiovisual immersive contexts and examine its creative potential using a reflexive research-creation approach. Our study reveals how IRL splits the role of the performer into three distinct positions: (1) the designer, who defines the parametric space; (2) the guide, who reinforces the agent’s behavior; and (3) the machine performer, whose actions are shaped by interactive training. As IRL introduces agency into the creative process, it transforms traditional notions of authorship and control, enabling unexpected emergent outcomes. By showcasing an interactive installation/performance, we further explore how audiences contribute to collective creation through reinforcement-based interaction. Our findings underscore the challenges of balancing the temporality of IRL with the demands of public-facing works and of adapting RL-based systems to different exhibition contexts. Our work contributes to the discourse on co-creative systems, emphasizing the evolving roles of artists, artificial agents, and audiences in hybrid creative ecosystems.},
 address = {Canberra, Australia},
 articleno = {76},
 author = {Danny Perreault and Victor Drouin-Trempe and Vincent Cusson and David Drouin and Sofian Audry},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.15698948},
 editor = {Doga Cavdir and Florent Berthaut},
 issn = {2220-4806},
 month = {June},
 numpages = {6},
 pages = {524--529},
 title = {From Performance to Installation: How Interactive Reinforcement Learning Reframes the Roles of Performers and Audiences},
 track = {Paper},
 url = {http://nime.org/proceedings/2025/nime2025_76.pdf},
 year = {2025}
}