Kinectofon: Performing with Shapes in Planes

Alexander Refsum Jensenius

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB anddepth image streams retrieved from a Microsoft Kinect sensor device. These twoimage streams are used to create different types of motiongrams, which, again, are used as the source material for a sonification process based on inverse FFT. The instrument is intuitive to play, allowing the performer to createsound by "touching" a virtual sound wall.

Citation

Alexander Refsum Jensenius. 2013. Kinectofon: Performing with Shapes in Planes. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178564

BibTeX Entry

@inproceedings{Jensenius2013,
 abstract = {The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB anddepth image streams retrieved from a Microsoft Kinect sensor device. These twoimage streams are used to create different types of motiongrams, which, again, are used as the source material for a sonification process based on inverse FFT. The instrument is intuitive to play, allowing the performer to createsound by "touching" a virtual sound wall.},
 address = {Daejeon, Republic of Korea},
 author = {Alexander Refsum Jensenius},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178564},
 issn = {2220-4806},
 keywords = {Kinect, motiongram, sonification, video analysis},
 month = {May},
 pages = {196--197},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Kinectofon: Performing with Shapes in Planes},
 url = {http://www.nime.org/proceedings/2013/nime2013_110.pdf},
 year = {2013}
}