A Study on Learning Advanced Skills on Co-Playable Robotic Instruments

Sang-won Leigh, and Jeonghyun (Jonna) Lee

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Learning advanced skills on a musical instrument takes a range of physical and cognitive efforts. For instance, practicing polyrhythm is a complex task that requires the development of both musical and physical skills. This paper explores the use of automation in the context of learning advanced skills on the guitar. Our robotic guitar is capable of physically plucking on the strings along with a musician, providing both haptic and audio guidance to the musician. We hypothesize that a multimodal and first-person experience of “being able to play” could increase learning efficacy. We discuss the novel learning application and a user study, through which we illustrate the implication and potential issues in systems that provide temporary skills and in-situ multimodal guidance for learning.

Citation:

Sang-won Leigh, and Jeonghyun (Jonna) Lee. 2021. A Study on Learning Advanced Skills on Co-Playable Robotic Instruments. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.21428/92fbeb44.002be215

BibTeX Entry:

  @inproceedings{NIME21_9,
 abstract = {Learning advanced skills on a musical instrument takes a range of physical and cognitive efforts. For instance, practicing polyrhythm is a complex task that requires the development of both musical and physical skills. This paper explores the use of automation in the context of learning advanced skills on the guitar. Our robotic guitar is capable of physically plucking on the strings along with a musician, providing both haptic and audio guidance to the musician. We hypothesize that a multimodal and first-person experience of “being able to play” could increase learning efficacy. We discuss the novel learning application and a user study, through which we illustrate the implication and potential issues in systems that provide temporary skills and in-situ multimodal guidance for learning.},
 address = {Shanghai, China},
 articleno = {9},
 author = {Leigh, Sang-won and Lee, Jeonghyun (Jonna)},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.002be215},
 issn = {2220-4806},
 month = {June},
 presentation-video = {https://youtu.be/MeXrN95jajU},
 title = {A Study on Learning Advanced Skills on Co-Playable Robotic Instruments},
 url = {https://nime.pubpub.org/pub/h5dqsvpm},
 year = {2021}
}