Recognition Of Multivariate Temporal Musical Gestures Using N-Dimensional Dynamic Time Warping

Nicholas Gillian, Benjamin Knapp, and Sile O'Modhrain

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper presents a novel algorithm that has been specifically designed for the recognition of multivariate temporal musical gestures. The algorithm is based on DynamicTime Warping and has been extended to classify any N dimensional signal, automatically compute a classificationthreshold to reject any data that is not a valid gesture andbe quickly trained with a low number of training examples.The algorithm is evaluated using a database of 10 temporalgestures performed by 10 participants achieving an averagecross-validation result of 99%.

Citation

Nicholas Gillian, Benjamin Knapp, and Sile O'Modhrain. 2011. Recognition Of Multivariate Temporal Musical Gestures Using N-Dimensional Dynamic Time Warping. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178029

BibTeX Entry

@inproceedings{Gillian2011,
 abstract = {This paper presents a novel algorithm that has been specifically designed for the recognition of multivariate temporal musical gestures. The algorithm is based on DynamicTime Warping and has been extended to classify any N dimensional signal, automatically compute a classificationthreshold to reject any data that is not a valid gesture andbe quickly trained with a low number of training examples.The algorithm is evaluated using a database of 10 temporalgestures performed by 10 participants achieving an averagecross-validation result of 99%.},
 address = {Oslo, Norway},
 author = {Gillian, Nicholas and Knapp, Benjamin and O'Modhrain, Sile},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178029},
 issn = {2220-4806},
 keywords = {Dynamic Time Warping, Gesture Recognition, Musician-Computer Interaction, Multivariate Temporal Gestures },
 pages = {337--342},
 presentation-video = {https://vimeo.com/26874428/},
 title = {Recognition Of Multivariate Temporal Musical Gestures Using N-Dimensional Dynamic Time Warping},
 url = {http://www.nime.org/proceedings/2011/nime2011_337.pdf},
 year = {2011}
}