Kinectofon: Performing with Shapes in Planes

Alexander Refsum Jensenius

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB anddepth image streams retrieved from a Microsoft Kinect sensor device. These twoimage streams are used to create different types of motiongrams, which, again, are used as the source material for a sonification process based on inverse FFT. The instrument is intuitive to play, allowing the performer to createsound by "touching" a virtual sound wall.

Citation:

Alexander Refsum Jensenius. 2013. Kinectofon: Performing with Shapes in Planes. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178564

BibTeX Entry:

  @inproceedings{Jensenius2013,
 abstract = {The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB anddepth image streams retrieved from a Microsoft Kinect sensor device. These twoimage streams are used to create different types of motiongrams, which, again, are used as the source material for a sonification process based on inverse FFT. The instrument is intuitive to play, allowing the performer to createsound by "touching" a virtual sound wall.},
 address = {Daejeon, Republic of Korea},
 author = {Alexander Refsum Jensenius},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178564},
 issn = {2220-4806},
 keywords = {Kinect, motiongram, sonification, video analysis},
 month = {May},
 pages = {196--197},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Kinectofon: Performing with Shapes in Planes},
 url = {http://www.nime.org/proceedings/2013/nime2013_110.pdf},
 year = {2013}
}