Wekinating 000000Swan : Using Machine Learning to Create and Control Complex Artistic Systems

Margaret Schedel, Phoenix Perry, and Rebecca Fiebrink

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2011
• Location: Oslo, Norway
• Pages: 453–456
• Keywords: Wekinator, K-Bow, Machine Learning, Interactive, Multimedia, Kinect, Motion-Tracking, Bow Articulation, Animation
• DOI: 10.5281/zenodo.1178151 (Link to paper)
• PDF link

Abstract:

In this paper we discuss how the band 000000Swan uses machine learning to parse complex sensor data and create intricate artistic systems for live performance. Using the Wekinator software for interactive machine learning, we have created discrete and continuous models for controlling audio and visual environments using human gestures sensed by a commercially-available sensor bow and the Microsoft Kinect. In particular, we have employed machine learning to quickly and easily prototype complex relationships between performer gesture and performative outcome.

Citation:

BibTeX Entry:

  @inproceedings{Schedel2011,
 abstract = {In this paper we discuss how the band 000000Swan uses machine learning to parse complex sensor data and create intricate artistic systems for live performance. Using the Wekinator software for interactive machine learning, we have created discrete and continuous models for controlling audio and visual environments using human gestures sensed by a commercially-available sensor bow and the Microsoft Kinect. In particular, we have employed machine learning to quickly and easily prototype complex relationships between performer gesture and performative outcome. },
 address = {Oslo, Norway},
 author = {Schedel, Margaret and Perry, Phoenix and Fiebrink, Rebecca},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178151},
 issn = {2220-4806},
 keywords = {Wekinator, K-Bow, Machine Learning, Interactive, Multimedia, Kinect, Motion-Tracking, Bow Articulation, Animation },
 pages = {453--456},
 title = {Wekinating 000000{S}wan : Using Machine Learning to Create and Control Complex Artistic Systems},
 url = {http://www.nime.org/proceedings/2011/nime2011_453.pdf},
 year = {2011}
}