Searching for Cross-Individual Relationships between Sound and Movement Features using an SVM Classifier

Kristian Nymoen, Kyrre Glette, Ståle A. Skogstad, Jim Torresen, and Alexander Refsum Jensenius

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper we present a method for studying relationships between features of sound and features of movement. The method has been tested by carrying out an experiment with people moving an object in space along with short sounds. 3D position data of the object was recorded and several features were calculated from each of the recordings. These features were provided as input to a classifier which was able to classify the recorded actions satisfactorily, particularly when taking into account that the only link between the actions performed by the different subjects was the sound they heard while making the action.

Citation:

Kristian Nymoen, Kyrre Glette, Ståle A. Skogstad, Jim Torresen, and Alexander Refsum Jensenius. 2010. Searching for Cross-Individual Relationships between Sound and Movement Features using an SVM Classifier. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177869

BibTeX Entry:

  @inproceedings{Nymoen2010,
 abstract = {In this paper we present a method for studying relationships between features of sound and features of movement. The method has been tested by carrying out an experiment with people moving an object in space along with short sounds. 3D position data of the object was recorded and several features were calculated from each of the recordings. These features were provided as input to a classifier which was able to classify the recorded actions satisfactorily, particularly when taking into account that the only link between the actions performed by the different subjects was the sound they heard while making the action.},
 address = {Sydney, Australia},
 author = {Nymoen, Kristian and Glette, Kyrre and Skogstad, Ståle A. and Torresen, Jim and Jensenius, Alexander Refsum},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177869},
 issn = {2220-4806},
 keywords = {nime10},
 pages = {259--262},
 title = {Searching for Cross-Individual Relationships between Sound and Movement Features using an {SVM} Classifier},
 url = {http://www.nime.org/proceedings/2010/nime2010_259.pdf},
 year = {2010}
}