Polyhymnia : An Automatic Piano Performance System with Statistical Modeling of Polyphonic Expression and Musical Symbol Interpretation

Tae Hun Kim, Satoru Fukayama, Takuya Nishimoto, and Shigeki Sagayama

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

We developed an automatic piano performance system calledPolyhymnia that is able to generate expressive polyphonicpiano performances with music scores so that it can be usedas a computer-based tool for an expressive performance.The system automatically renders expressive piano musicby means of automatic musical symbol interpretation andstatistical models of structure-expression relations regarding polyphonic features of piano performance. Experimental results indicate that the generated performances of various piano pieces with diverse trained models had polyphonicexpression and sounded expressively. In addition, the models trained with different performance styles reflected thestyles observed in the training performances, and they werewell distinguishable by human listeners. Polyhymnia wonthe first prize in the autonomous section of the PerformanceRendering Contest for Computer Systems (Rencon) 2010.

Citation:

Tae Hun Kim, Satoru Fukayama, Takuya Nishimoto, and Shigeki Sagayama. 2011. Polyhymnia : An Automatic Piano Performance System with Statistical Modeling of Polyphonic Expression and Musical Symbol Interpretation. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178069

BibTeX Entry:

  @inproceedings{Kim2011b,
 abstract = {We developed an automatic piano performance system calledPolyhymnia that is able to generate expressive polyphonicpiano performances with music scores so that it can be usedas a computer-based tool for an expressive performance.The system automatically renders expressive piano musicby means of automatic musical symbol interpretation andstatistical models of structure-expression relations regarding polyphonic features of piano performance. Experimental results indicate that the generated performances of various piano pieces with diverse trained models had polyphonicexpression and sounded expressively. In addition, the models trained with different performance styles reflected thestyles observed in the training performances, and they werewell distinguishable by human listeners. Polyhymnia wonthe first prize in the autonomous section of the PerformanceRendering Contest for Computer Systems (Rencon) 2010.},
 address = {Oslo, Norway},
 author = {Kim, Tae Hun and Fukayama, Satoru and Nishimoto, Takuya and Sagayama, Shigeki},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178069},
 issn = {2220-4806},
 keywords = {performance rendering, polyphonic expression, statistical modeling, conditional random fields },
 pages = {96--99},
 title = {Polyhymnia : An Automatic Piano Performance System with Statistical Modeling of Polyphonic Expression and Musical Symbol Interpretation},
 url = {http://www.nime.org/proceedings/2011/nime2011_096.pdf},
 year = {2011}
}