Skip to content

Visual Methods for the Retrieval of Guitarist Fingering

Anne-Marie Burns, and Marcelo M. Wanderley

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This article presents a method to visually detect and recognize fingering gestures of the left hand of a guitarist. This method has been developed following preliminary manual and automated analysis of video recordings. These first analyses led to some important findings about the design methodology of a vision system for guitarist fingering, namely the focus on the effective gesture, the consideration of the action of each individual finger, and a recognition system not relying on comparison against a knowledge base of previously learned fingering positions. Motivated by these results, studies on three aspects of a complete fingering system were conducted: the first on finger tracking; the second on strings and frets detection; and the last one on movement segmentation. Finally, these concepts were integrated into a prototype and a system for left hand fingering detection was developed.

Citation

Anne-Marie Burns, and Marcelo M. Wanderley. 2006. Visual Methods for the Retrieval of Guitarist Fingering. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176850 [PDF]

BibTeX Entry


@inproceedings{nime2006_Burns,
author = {Burns, Anne-Marie and Wanderley, Marcelo M.},
title = {Visual Methods for the Retrieval of Guitarist Fingering},
pages = {196--199},
booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
year = {2006},
address = {Paris, France},
issn = {2220-4806},
doi = {10.5281/zenodo.1176850},
url = {https://nime.org/proceedings/2006/nime2006_196.pdf},
keywords = {finger-tracking,gesture,guitar fingering,hough transform},
abstract = {This article presents a method to visually detect and recognize fingering gestures of the left hand of a guitarist. This method has been developed following preliminary manual and automated analysis of video recordings. These first analyses led to some important findings about the design methodology of a vision system for guitarist fingering, namely the focus on the effective gesture, the consideration of the action of each individual finger, and a recognition system not relying on comparison against a knowledge base of previously learned fingering positions. Motivated by these results, studies on three aspects of a complete fingering system were conducted: the first on finger tracking; the second on strings and frets detection; and the last one on movement segmentation. Finally, these concepts were integrated into a prototype and a system for left hand fingering detection was developed.}
}