The Multimodal Music Stand

Bo Bell, Jim Kleban, Dan Overholt, Lance Putnam, John Thompson, and JoAnn Morin-Kuchera

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2007
• Location: New York City, NY, United States
• Pages: 62–65
• Keywords: Multimodal, interactivity, computer vision, e-field sensing, untethered control.
• DOI: 10.5281/zenodo.1177039 (Link to paper)
• PDF link

Abstract:

We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.

Citation:

BibTeX Entry:

  @inproceedings{Bell2007,
 abstract = {We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio. },
 address = {New York City, NY, United States},
 author = {Bell, Bo and Kleban, Jim and Overholt, Dan and Putnam, Lance and Thompson, John and Morin-Kuchera, JoAnn},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177039},
 issn = {2220-4806},
 keywords = {Multimodal, interactivity, computer vision, e-field sensing, untethered control. },
 pages = {62--65},
 title = {The Multimodal Music Stand},
 url = {http://www.nime.org/proceedings/2007/nime2007_062.pdf},
 year = {2007}
}