Hand-Controller for Combined Tactile Control and Motion Tracking

Laurel Pardue, and William Sebastian

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2013
• Location: Daejeon, Republic of Korea
• Pages: 90–93
• Keywords: hand, interface, free gesture, force sensing resistor, new musical instrument, tactile feedback, position tracking
• DOI: 10.5281/zenodo.1178630 (Link to paper)
• PDF link

Abstract:

The Hand Controller is a new interface designed to enable a performer toachieve detailed control of audio and visual parameters through a tangibleinterface combined with motion tracking of the hands to capture large scalephysical movement. Such movement empowers an expressive dynamic for bothperformer and audience. However tracking movements in free space isnotoriously difficult for virtuosic performance. The lack of tactile feedbackleads to difficulty learning the repeated muscle movements required for precisecontrol. In comparison, the hands have shown an impressive ability to mastercomplex motor tasks through feel. The hand controller uses both modes ofinteraction. Electro-magnetic field tracking enables 6D hand motion trackingwhile two options provide tactile interaction- a set of tracks that providelinear positioning and applied finger pressure, or a set of trumpet like sliderkeys that provide continuous data describing key depth. Thumbs actuateadditional pressure sensitive buttons. The two haptic interfaces are mountedto a comfortable hand grip that allows a significant range of reach, andpressure to be applied without restricting hand movement highly desirable inexpressive motion.

Citation:

BibTeX Entry:

  @inproceedings{Pardue2013,
 abstract = {The Hand Controller is a new interface designed to enable a performer toachieve detailed control of audio and visual parameters through a tangibleinterface combined with motion tracking of the hands to capture large scalephysical movement. Such movement empowers an expressive dynamic for bothperformer and audience. However tracking movements in free space isnotoriously difficult for virtuosic performance. The lack of tactile feedbackleads to difficulty learning the repeated muscle movements required for precisecontrol. In comparison, the hands have shown an impressive ability to mastercomplex motor tasks through feel. The hand controller uses both modes ofinteraction. Electro-magnetic field tracking enables 6D hand motion trackingwhile two options provide tactile interaction- a set of tracks that providelinear positioning and applied finger pressure, or a set of trumpet like sliderkeys that provide continuous data describing key depth. Thumbs actuateadditional pressure sensitive buttons. The two haptic interfaces are mountedto a comfortable hand grip that allows a significant range of reach, andpressure to be applied without restricting hand movement highly desirable inexpressive motion.},
 address = {Daejeon, Republic of Korea},
 author = {Laurel Pardue and William Sebastian},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178630},
 issn = {2220-4806},
 keywords = {hand, interface, free gesture, force sensing resistor, new musical instrument, tactile feedback, position tracking},
 month = {May},
 pages = {90--93},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Hand-Controller for Combined Tactile Control and Motion Tracking},
 url = {http://www.nime.org/proceedings/2013/nime2013_245.pdf},
 year = {2013}
}