Voice at NIME: a Taxonomy of New Interfaces for Vocal Musical Expression

Rébecca Kleinberger, Nikhil Singh, Xiao Xiao, and Akito van Troyer

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2022
• Location: The University of Auckland, New Zealand
• Article Number: 8
• DOI: 10.21428/92fbeb44.4308fb94 (Link to paper)
• PDF link
• Presentation Video

Abstract:

We present a systematic review of voice-centered NIME publications from the past two decades. Musical expression has been a key driver of innovation in voicebased technologies, from traditional architectures that amplify singing to cutting-edge research in vocal synthesis. NIME conference has emerged as a prime venue for innovative vocal interfaces. However, there hasn’t been a systematic analysis of all voice-related work or an effort to characterize their features. Analyzing trends in Vocal NIMEs can help the community better understand common interests, identify uncharted territories, and explore directions for future research. We identified a corpus of 98 papers about Vocal NIMEs from 2001 to 2021, which we analyzed in 3 ways. First, we automatically extracted latent themes and possible categories using natural language processing. Taking inspiration from concepts surfaced through this process, we then defined several core dimensions with associated descriptors of Vocal NIMEs and assigned each paper relevant descriptors under each dimension. Finally, we defined a classification system, which we then used to uniquely and more precisely situate each paper on a map, taking into account the overall goals of each work. Based on our analyses, we present trends and challenges, including questions of gender and diversity in our community, and reflect on opportunities for future work.

Citation:

BibTeX Entry:

  @inproceedings{NIME22_8,
 abstract = {We present a systematic review of voice-centered NIME publications from the past two decades. Musical expression has been a key driver of innovation in voicebased technologies, from traditional architectures that amplify singing to cutting-edge research in vocal synthesis. NIME conference has emerged as a prime venue for innovative vocal interfaces. However, there hasn’t been a systematic analysis of all voice-related work or an effort to characterize their features. Analyzing trends in Vocal NIMEs can help the community better understand common interests, identify uncharted territories, and explore directions for future research. We identified a corpus of 98 papers about Vocal NIMEs from 2001 to 2021, which we analyzed in 3 ways. First, we automatically extracted latent themes and possible categories using natural language processing. Taking inspiration from concepts surfaced through this process, we then defined several core dimensions with associated descriptors of Vocal NIMEs and assigned each paper relevant descriptors under each dimension. Finally, we defined a classification system, which we then used to uniquely and more precisely situate each paper on a map, taking into account the overall goals of each work. Based on our analyses, we present trends and challenges, including questions of gender and diversity in our community, and reflect on opportunities for future work.},
 address = {The University of Auckland, New Zealand},
 articleno = {8},
 author = {Kleinberger, R{\'{e}}becca and Singh, Nikhil and Xiao, Xiao and Troyer, Akito van},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.4308fb94},
 issn = {2220-4806},
 month = {jun},
 pdf = {112.pdf},
 presentation-video = {https://youtu.be/PUlGjAblfPM},
 title = {Voice at {NIME}: a Taxonomy of New Interfaces for Vocal Musical Expression},
 url = {https://doi.org/10.21428%2F92fbeb44.4308fb94},
 year = {2022}
}