A Compact Spectrum-Assisted Human Beatboxing Reinforcement Learning Tool On Smartphone

Simon Lui

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Music is expressive and hard to be described by words. Learning music istherefore not a straightforward task especially for vocal music such as humanbeatboxing. People usually learn beatboxing in the traditional way of imitatingaudio sample without steps and instructions. Spectrogram contains a lot ofinformation about audio, but it is too complicated to be understood inreal-time. Reinforcement learning is a psychological method, which makes use ofreward and/or punishment as stimulus to train the decision-making process ofhuman. We propose a novel music learning approach based on the reinforcementlearning method, which makes use of compact and easy-to-read spectruminformation as visual clue to assist human beatboxing learning on smartphone.Experimental result shows that the visual information is easy to understand inreal-time, which improves the effectiveness of beatboxing self-learning.

Citation

Simon Lui. 2013. A Compact Spectrum-Assisted Human Beatboxing Reinforcement Learning Tool On Smartphone. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178600

BibTeX Entry

@inproceedings{Lui2013,
 abstract = {Music is expressive and hard to be described by words. Learning music istherefore not a straightforward task especially for vocal music such as humanbeatboxing. People usually learn beatboxing in the traditional way of imitatingaudio sample without steps and instructions. Spectrogram contains a lot ofinformation about audio, but it is too complicated to be understood inreal-time. Reinforcement learning is a psychological method, which makes use ofreward and/or punishment as stimulus to train the decision-making process ofhuman. We propose a novel music learning approach based on the reinforcementlearning method, which makes use of compact and easy-to-read spectruminformation as visual clue to assist human beatboxing learning on smartphone.Experimental result shows that the visual information is easy to understand inreal-time, which improves the effectiveness of beatboxing self-learning.},
 address = {Daejeon, Republic of Korea},
 author = {Simon Lui},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178600},
 issn = {2220-4806},
 keywords = {Audio analysis, music learning tool, reinforcement learning, smartphone app, audio information retrieval.},
 month = {May},
 pages = {25--28},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {A Compact Spectrum-Assisted Human Beatboxing Reinforcement Learning Tool On Smartphone},
 url = {http://www.nime.org/proceedings/2013/nime2013_79.pdf},
 year = {2013}
}