Tongue `n' Groove: An Ultrasound based Music Controller

Florian Vogt, Graeme Mccaig, Mir A. Ali, and Sidney S. Fels

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete tongue shape to control, in realtime, a musical synthesizer and musical effects. We evaluate the mapping space between tongue shape and controller parameters and its expressive characteristics.

Citation

Florian Vogt, Graeme Mccaig, Mir A. Ali, and Sidney S. Fels. 2002. Tongue `n' Groove: An Ultrasound based Music Controller. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176468

BibTeX Entry

@inproceedings{Vogt2002,
 abstract = {Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete tongue shape to control, in realtime, a musical synthesizer and musical effects. We evaluate the mapping space between tongue shape and controller parameters and its expressive characteristics.},
 address = {Dublin, Ireland},
 author = {Vogt, Florian and Mccaig, Graeme and Ali, Mir A. and Fels, Sidney S.},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 date = {24-26 May, 2002},
 doi = {10.5281/zenodo.1176468},
 issn = {2220-4806},
 keywords = {Tongue model, ultrasound, real-time, music synthesis, speech interface},
 pages = {181--185},
 title = {Tongue `n' Groove: An Ultrasound based Music Controller},
 url = {http://www.nime.org/proceedings/2002/nime2002_181.pdf},
 year = {2002}
}