Multi Sensor Tracking for Live Sound Transformation

Anton Fuhrmann, Johannes Kretz, and Peter Burwik

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2013
• Location: Daejeon, Republic of Korea
• Pages: 358–362
• Keywords: kinect, multi sensor, sensor fusion, open sound control, motion tracking, parameter mapping, live electronics
• DOI: 10.5281/zenodo.1178530 (Link to paper)
• PDF link

Abstract:

This paper demonstrates how to use multiple Kinect(TM) sensors to map aperformers motion to music. We merge skeleton data streams from multiplesensors to compensate for occlusions of the performer. The skeleton jointpositions drive the performance via open sound control data. We discuss how toregister the different sensors to each other and how to smoothly merge theresulting data streams and how to map position data in a general framework tothe live electronics applied to a chamber music ensemble.

Citation:

BibTeX Entry:

  @inproceedings{Fuhrmann2013,
 abstract = {This paper demonstrates how to use multiple Kinect(TM) sensors to map aperformers motion to music. We merge skeleton data streams from multiplesensors to compensate for occlusions of the performer. The skeleton jointpositions drive the performance via open sound control data. We discuss how toregister the different sensors to each other and how to smoothly merge theresulting data streams and how to map position data in a general framework tothe live electronics applied to a chamber music ensemble.},
 address = {Daejeon, Republic of Korea},
 author = {Anton Fuhrmann and Johannes Kretz and Peter Burwik},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178530},
 issn = {2220-4806},
 keywords = {kinect, multi sensor, sensor fusion, open sound control, motion tracking, parameter mapping, live electronics},
 month = {May},
 pages = {358--362},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Multi Sensor Tracking for Live Sound Transformation},
 url = {http://www.nime.org/proceedings/2013/nime2013_44.pdf},
 year = {2013}
}