A Musical Performance Evaluation System for Beginner Musician based on Real-time Score Following

Yoonchang Han, Sejun Kwon, Kibeom Lee, and Kyogu Lee

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper proposes a musical performance feedback system based on real-time audio-score alignment for musical instrument education of beginner musicians. In the proposed system, we do not make use of symbolic data such as MIDI, but acquire a real-time audio input from on-board microphone of smartphone. Then, the system finds onset and pitch of the note from the signal, to align this information with the ground truth musical score. Real-time alignment allows the system to evaluate whether the user played the correct note or not, regardless of its timing, which enables user to play at their own speed, as playing same tempo with original musical score is problematic for beginners. As an output of evaluation, the system notifies the user about which part they are currently performing, and which note were played incorrectly.

Citation:

Yoonchang Han, Sejun Kwon, Kibeom Lee, and Kyogu Lee. 2013. A Musical Performance Evaluation System for Beginner Musician based on Real-time Score Following. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178546

BibTeX Entry:

  @inproceedings{Han2013,
 abstract = {This paper proposes a musical performance feedback system based on real-time audio-score alignment for musical instrument education of beginner musicians. In the proposed system, we do not make use of symbolic data such as MIDI, but acquire a real-time audio input from on-board microphone of smartphone. Then, the system finds onset and pitch of the note from the signal, to align this information with the ground truth musical score. Real-time alignment allows the system to evaluate whether the user played the correct note or not, regardless of its timing, which enables user to play at their own speed, as playing same tempo with original musical score is problematic for beginners. As an output of evaluation, the system notifies the user about which part they are currently performing, and which note were played incorrectly.},
 address = {Daejeon, Republic of Korea},
 author = {Yoonchang Han and Sejun Kwon and Kibeom Lee and Kyogu Lee},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178546},
 issn = {2220-4806},
 keywords = {Music performance analysis, Music education, Real-time score following},
 month = {May},
 pages = {120--121},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {A Musical Performance Evaluation System for Beginner Musician based on Real-time Score Following},
 url = {http://www.nime.org/proceedings/2013/nime2013_60.pdf},
 year = {2013}
}