Exploring Human-Machine Synergy and Interaction on a Robotic Instrument

Sang-won Leigh, Abhinandan Jain, and Pattie Maes

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper introduces studies conducted with musicians that aim to understand modes of human-robot interaction, situated between automation and human augmentation. Our robotic guitar system used for the study consists of various sound generating mechanisms, either driven by software or by a musician directly. The control mechanism allows the musician to have a varying degree of agency over the overall musical direction. We present interviews and discussions on open-ended experiments conducted with music students and musicians. The outcome of this research includes new modes of playing the guitar given the robotic capabilities, and an understanding of how automation can be integrated into instrument-playing processes. The results present insights into how a human-machine hybrid system can increase the efficacy of training or exploration, without compromising human engagement with a task.

Citation:

Sang-won Leigh, Abhinandan Jain, and Pattie Maes. 2019. Exploring Human-Machine Synergy and Interaction on a Robotic Instrument. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.3673027

BibTeX Entry:

  @inproceedings{Leigh2019,
 abstract = {This paper introduces studies conducted with musicians that aim to understand modes of human-robot interaction, situated between automation and human augmentation. Our robotic guitar system used for the study consists of various sound generating mechanisms, either driven by software or by a musician directly. The control mechanism allows the musician to have a varying degree of agency over the overall musical direction. We present interviews and discussions on open-ended experiments conducted with music students and musicians. The outcome of this research includes new modes of playing the guitar given the robotic capabilities, and an understanding of how automation can be integrated into instrument-playing processes. The results present insights into how a human-machine hybrid system can increase the efficacy of training or exploration, without compromising human engagement with a task.},
 address = {Porto Alegre, Brazil},
 author = {Sang-won Leigh and Abhinandan Jain and Pattie Maes},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.3673027},
 editor = {Marcelo Queiroz and Anna Xambó Sedó},
 issn = {2220-4806},
 month = {June},
 pages = {437--442},
 publisher = {UFRGS},
 title = {Exploring Human-Machine Synergy and Interaction on a Robotic Instrument},
 url = {http://www.nime.org/proceedings/2019/nime2019_paper086.pdf},
 year = {2019}
}