Tongue `n' Groove: An Ultrasound based Music Controller

Florian Vogt, Graeme Mccaig, Mir A. Ali, and Sidney S. Fels

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete tongue shape to control, in realtime, a musical synthesizer and musical effects. We evaluate the mapping space between tongue shape and controller parameters and its expressive characteristics.

Citation:

Florian Vogt, Graeme Mccaig, Mir A. Ali, and Sidney S. Fels. 2002. Tongue `n' Groove: An Ultrasound based Music Controller. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176468

BibTeX Entry:

  @inproceedings{Vogt2002,
 abstract = {Here we propose a novel musical controller which acquires imaging data of the tongue with a two-dimensional medical ultrasound scanner. A computer vision algorithm extracts from the image a discrete tongue shape to control, in realtime, a musical synthesizer and musical effects. We evaluate the mapping space between tongue shape and controller parameters and its expressive characteristics.},
 address = {Dublin, Ireland},
 author = {Vogt, Florian and Mccaig, Graeme and Ali, Mir A. and Fels, Sidney S.},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 date = {24-26 May, 2002},
 doi = {10.5281/zenodo.1176468},
 issn = {2220-4806},
 keywords = {Tongue model, ultrasound, real-time, music synthesis, speech interface},
 pages = {181--185},
 title = {Tongue `n' Groove: An Ultrasound based Music Controller},
 url = {http://www.nime.org/proceedings/2002/nime2002_181.pdf},
 year = {2002}
}