FutureGrab: A wearable subtractive synthesizer using hand gesture

Yoonchang Han, Jinsoo Na, and Kyogu Lee

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2012
• Location: Ann Arbor, Michigan
• Keywords: Wearable musical instrument, Pure Data, gestural synthesis, formant synthesis, data-glove, visual feedback, subtractive synthesis
• DOI: 10.5281/zenodo.1178271 (Link to paper)
• PDF link

Abstract:

FutureGrab is a new wearable musical instrument for live performance that is highly intuitive while still generating an interesting sound by subtractive synthesis. Its sound effects resemble the human vowel pronunciation, which were mapped to hand gestures that are similar to the mouth shape of human to pronounce corresponding vowel. FutureGrab also provides all necessary features for a lead musical instrument such as pitch control, trigger, glissando and key adjustment. In addition, pitch indicator was added to give visual feedback to the performer, which can reduce the mistakes during live performances. This paper describes the motivation, system design, mapping strategy and implementation of FutureGrab, and evaluates the overall experience.

Citation:

BibTeX Entry:

  @inproceedings{Han2012a,
 abstract = {FutureGrab is a new wearable musical instrument for live performance that is highly intuitive while still generating an interesting sound by subtractive synthesis. Its sound effects resemble the human vowel pronunciation, which were mapped to hand gestures that are similar to the mouth shape of human to pronounce corresponding vowel. FutureGrab also provides all necessary features for a lead musical instrument such as pitch control, trigger, glissando and key adjustment. In addition, pitch indicator was added to give visual feedback to the performer, which can reduce the mistakes during live performances. This paper describes the motivation, system design, mapping strategy and implementation of FutureGrab, and evaluates the overall experience.},
 address = {Ann Arbor, Michigan},
 author = {Yoonchang Han and Jinsoo Na and Kyogu Lee},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178271},
 issn = {2220-4806},
 keywords = {Wearable musical instrument, Pure Data, gestural synthesis, formant synthesis, data-glove, visual feedback, subtractive synthesis},
 publisher = {University of Michigan},
 title = {FutureGrab: A wearable subtractive synthesizer using hand gesture},
 url = {http://www.nime.org/proceedings/2012/nime2012_209.pdf},
 year = {2012}
}