Hand Posture Recognition: IR, IMU and sEMG

Richard Polfreman

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Hands are important anatomical structures for musical performance, and recent developments in input device technology have allowed rather detailed capture of hand gestures using consumer-level products. While in some musical contexts, detailed hand and finger movements are required, in others it is sufficient to communicate discrete hand postures to indicate selection or other state changes. This research compared three approaches to capturing hand gestures where the shape of the hand, i.e. the relative positions and angles of finger joints, are an important part of the gesture. A number of sensor types can be used to capture information about hand posture, each of which has various practical advantages and disadvantages for music applications. This study compared three approaches, using optical, inertial and muscular information, with three sets of 5 hand postures (i.e. static gestures) and gesture recognition algorithms applied to the device data, aiming to determine which methods are most effective.

Citation:

Richard Polfreman. 2018. Hand Posture Recognition: IR, IMU and sEMG. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1302571

BibTeX Entry:

  @inproceedings{Polfreman2018,
 abstract = {Hands are important anatomical structures for musical performance, and recent developments in input device technology have allowed rather detailed capture of hand gestures using consumer-level products. While in some musical contexts, detailed hand and finger movements are required, in others it is sufficient to communicate discrete hand postures to indicate selection or other state changes. This research compared three approaches to capturing hand gestures where the shape of the hand, i.e. the relative positions and angles of finger joints, are an important part of the gesture. A number of sensor types can be used to capture information about hand posture, each of which has various practical advantages and disadvantages for music applications. This study compared three approaches, using optical, inertial and muscular information, with three sets of 5 hand postures (i.e. static gestures) and gesture recognition algorithms applied to the device data, aiming to determine which methods are most effective.},
 address = {Blacksburg, Virginia, USA},
 author = {Richard Polfreman},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1302571},
 editor = {Luke Dahl, Douglas Bowman, Thomas Martin},
 isbn = {978-1-949373-99-8},
 issn = {2220-4806},
 month = {June},
 pages = {249--254},
 publisher = {Virginia Tech},
 title = {Hand Posture Recognition: IR, IMU and sEMG},
 url = {http://www.nime.org/proceedings/2018/nime2018_paper0054.pdf},
 year = {2018}
}