Real Time Gesture Learning and Recognition : Towards Automatic Categorization

Jean-Baptiste Thiebaut, Samer Abdallah, Andrew Robertson, Nick Bryan-Kinns, and Mark D. Plumbley

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2008
• Location: Genoa, Italy
• Pages: 215–218
• Keywords: Gesture recognition, supervised and unsupervised learning, interaction, haptic feedback, information dynamics, HMMs
• DOI: 10.5281/zenodo.1179639 (Link to paper)
• PDF link

Abstract:

This research focuses on real-time gesture learning and recognition. Events arrive in a continuous stream without explicitly given boundaries. To obtain temporal accuracy, weneed to consider the lag between the detection of an eventand any effects we wish to trigger with it. Two methodsfor real time gesture recognition using a Nintendo Wii controller are presented. The first detects gestures similar to agiven template using either a Euclidean distance or a cosinesimilarity measure. The second method uses novel information theoretic methods to detect and categorize gestures inan unsupervised way. The role of supervision, detection lagand the importance of haptic feedback are discussed.

Citation:

BibTeX Entry:

  @inproceedings{Thiebaut2008,
 abstract = {This research focuses on real-time gesture learning and recognition. Events arrive in a continuous stream without explicitly given boundaries. To obtain temporal accuracy, weneed to consider the lag between the detection of an eventand any effects we wish to trigger with it. Two methodsfor real time gesture recognition using a Nintendo Wii controller are presented. The first detects gestures similar to agiven template using either a Euclidean distance or a cosinesimilarity measure. The second method uses novel information theoretic methods to detect and categorize gestures inan unsupervised way. The role of supervision, detection lagand the importance of haptic feedback are discussed.},
 address = {Genoa, Italy},
 author = {Thiebaut, Jean-Baptiste and Abdallah, Samer and Robertson, Andrew and Bryan-Kinns, Nick and Plumbley, Mark D.},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1179639},
 issn = {2220-4806},
 keywords = {Gesture recognition, supervised and unsupervised learning, interaction, haptic feedback, information dynamics, HMMs },
 pages = {215--218},
 title = {Real Time Gesture Learning and Recognition : Towards Automatic Categorization},
 url = {http://www.nime.org/proceedings/2008/nime2008_215.pdf},
 year = {2008}
}