A Robot Musician Interacting with a Human Partner through Initiative Exchange

Ye Pan, Min-Gyu Kim, and Kenji Suzuki

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper proposes a novel method to realize an initiativeexchange for robot. A humanoid robot plays vibraphone exchanging initiative with a human performer by perceivingmultimodal cues in real time. It understands the initiative exchange cues through vision and audio information.In order to achieve the natural initiative exchange betweena human and a robot in musical performance, we built thesystem and the software architecture and carried out the experiments for fundamental algorithms which are necessaryto the initiative exchange.

Citation

Ye Pan, Min-Gyu Kim, and Kenji Suzuki. 2010. A Robot Musician Interacting with a Human Partner through Initiative Exchange. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177875

BibTeX Entry

@inproceedings{Pan2010,
 abstract = {This paper proposes a novel method to realize an initiativeexchange for robot. A humanoid robot plays vibraphone exchanging initiative with a human performer by perceivingmultimodal cues in real time. It understands the initiative exchange cues through vision and audio information.In order to achieve the natural initiative exchange betweena human and a robot in musical performance, we built thesystem and the software architecture and carried out the experiments for fundamental algorithms which are necessaryto the initiative exchange.},
 address = {Sydney, Australia},
 author = {Pan, Ye and Kim, Min-Gyu and Suzuki, Kenji},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177875},
 issn = {2220-4806},
 keywords = {Human-robot interaction, initiative exchange, prediction},
 pages = {166--169},
 title = {A Robot Musician Interacting with a Human Partner through Initiative Exchange},
 url = {http://www.nime.org/proceedings/2010/nime2010_166.pdf},
 year = {2010}
}