Paralinguistic Microphone

Alex McLean, EunJoo Shin, and Kia Ng

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The Human vocal tract is considered for its sonorous qualities incarrying prosodic information, which implicates vision in theperceptual processes of speech. These considerations are put in thecontext of previous work in NIME, forming background for theintroduction of two sound installations; ``Microphone'', which uses acamera and computer vision to translate mouth shapes to sounds, and``Microphone II'', a work-in-progress, which adds physical modellingsynthesis as a sound source, and visualisation of mouth movements.

Citation:

Alex McLean, EunJoo Shin, and Kia Ng. 2013. Paralinguistic Microphone. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178608

BibTeX Entry:

  @inproceedings{McLean2013,
 abstract = {The Human vocal tract is considered for its sonorous qualities incarrying prosodic information, which implicates vision in theperceptual processes of speech. These considerations are put in thecontext of previous work in NIME, forming background for theintroduction of two sound installations; ``Microphone'', which uses acamera and computer vision to translate mouth shapes to sounds, and``Microphone II'', a work-in-progress, which adds physical modellingsynthesis as a sound source, and visualisation of mouth movements.},
 address = {Daejeon, Republic of Korea},
 author = {Alex McLean and EunJoo Shin and Kia Ng},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178608},
 issn = {2220-4806},
 keywords = {face tracking, computer vision, installation, microphone},
 month = {May},
 pages = {381--384},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Paralinguistic Microphone},
 url = {http://www.nime.org/proceedings/2013/nime2013_122.pdf},
 year = {2013}
}