Skip to content

Paralinguistic Microphone

Alex McLean, EunJoo Shin, and Kia Ng

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

The Human vocal tract is considered for its sonorous qualities incarrying prosodic information, which implicates vision in theperceptual processes of speech. These considerations are put in thecontext of previous work in NIME, forming background for theintroduction of two sound installations; ``Microphone'', which uses acamera and computer vision to translate mouth shapes to sounds, and``Microphone II'', a work-in-progress, which adds physical modellingsynthesis as a sound source, and visualisation of mouth movements.

Citation

Alex McLean, EunJoo Shin, and Kia Ng. 2013. Paralinguistic Microphone. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178608 [PDF]

BibTeX Entry


@inproceedings{nime2013_McLean,
author = {Alex McLean and EunJoo Shin and Kia Ng},
title = {Paralinguistic Microphone},
pages = {381--384},
booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
year = {2013},
month = {May},
publisher = {Graduate School of Culture Technology, KAIST},
address = {Daejeon, Republic of Korea},
issn = {2220-4806},
doi = {10.5281/zenodo.1178608},
url = {https://nime.org/proceedings/2013/nime2013_122.pdf},
keywords = {face tracking, computer vision, installation, microphone},
abstract = {The Human vocal tract is considered for its sonorous qualities incarrying prosodic information, which implicates vision in theperceptual processes of speech. These considerations are put in thecontext of previous work in NIME, forming background for theintroduction of two sound installations; ``Microphone'', which uses acamera and computer vision to translate mouth shapes to sounds, and``Microphone II'', a work-in-progress, which adds physical modellingsynthesis as a sound source, and visualisation of mouth movements.}
}