The Multimodal Music Stand

Bo Bell, Jim Kleban, Dan Overholt, Lance Putnam, John Thompson, and JoAnn Morin-Kuchera

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.

Citation

Bo Bell, Jim Kleban, Dan Overholt, Lance Putnam, John Thompson, and JoAnn Morin-Kuchera. 2007. The Multimodal Music Stand. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177039

BibTeX Entry

@inproceedings{Bell2007,
 abstract = {We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio. },
 address = {New York City, NY, United States},
 author = {Bell, Bo and Kleban, Jim and Overholt, Dan and Putnam, Lance and Thompson, John and Morin-Kuchera, JoAnn},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177039},
 issn = {2220-4806},
 keywords = {Multimodal, interactivity, computer vision, e-field sensing, untethered control. },
 pages = {62--65},
 title = {The Multimodal Music Stand},
 url = {http://www.nime.org/proceedings/2007/nime2007_062.pdf},
 year = {2007}
}