LiVo: Sing a Song with a Vowel Keyboard

Kazuhiko Yamamoto, and Takeo Igarashi

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2015
• Location: Baton Rouge, Louisiana, USA
• Pages: 205–208
• DOI: 10.5281/zenodo.1181414 (Link to paper)
• PDF link
• Supplementary File 1: 0120-file1.mp4

Abstract:

We propose a novel user interface that enables control of a singing voice synthesizer at a live improvisational performance. The user first registers the lyrics of a song with the system before performance, and the system builds a probabilistic model that models the possible jumps within the lyrics. During performance, the user simultaneously inputs the lyrics of a song with the left hand using a vowel keyboard and the melodies with the right hand using a standard musical keyboard. Our system searches for a portion of the registered lyrics whose vowel sequence matches the current user input using the probabilistic model, and sends the matched lyrics to the singing voice synthesizer. The vowel input keys are mapped onto a standard musical keyboard, enabling experienced keyboard players to learn the system from a standard musical score. We examine the feasibility of the system through a series of evaluations and user studies.

Citation:

BibTeX Entry:

  @inproceedings{kyamamoto2015,
 abstract = {We propose a novel user interface that enables control of a singing voice synthesizer at a live improvisational performance. The user first registers the lyrics of a song with the system before performance, and the system builds a probabilistic model that models the possible jumps within the lyrics. During performance, the user simultaneously inputs the lyrics of a song with the left hand using a vowel keyboard and the melodies with the right hand using a standard musical keyboard. Our system searches for a portion of the registered lyrics whose vowel sequence matches the current user input using the probabilistic model, and sends the matched lyrics to the singing voice synthesizer. The vowel input keys are mapped onto a standard musical keyboard, enabling experienced keyboard players to learn the system from a standard musical score. We examine the feasibility of the system through a series of evaluations and user studies. },
 address = {Baton Rouge, Louisiana, USA},
 author = {Kazuhiko Yamamoto and Takeo Igarashi},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1181414},
 editor = {Edgar Berdahl and Jesse Allison},
 issn = {2220-4806},
 month = {May},
 pages = {205--208},
 publisher = {Louisiana State University},
 title = {LiVo: Sing a Song with a Vowel Keyboard},
 url = {http://www.nime.org/proceedings/2015/nime2015_120.pdf},
 urlsuppl1 = {http://www.nime.org/proceedings/2015/120/0120-file1.mp4},
 year = {2015}
}