Crossole: A Gestural Interface for Composition, Improvisation and Performance using Kinect

Sertan Şentürk, Sang Won Lee, Avinash Sastry, Anosh Daruwalla, and Gil Weinberg

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Meaning crossword of sound, Crossole is a musical meta-instrument where the music is visualized as a set of virtual blocks that resemble a crossword puzzle. In Crossole, the chord progressions are visually presented as a set of virtual blocks. With the aid of the Kinect sensing technology, a performer controls music by manipulating the crossword blocks using hand movements. The performer can build chords in the high level, traverse over the blocks, step into the low level to control the chord arpeggiations note by note, loop a chord progression or map gestures to various processing algorithms to enhance the timbral scenery.

Citation:

Sertan Şentürk, Sang Won Lee, Avinash Sastry, Anosh Daruwalla, and Gil Weinberg. 2012. Crossole: A Gestural Interface for Composition, Improvisation and Performance using Kinect. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178201

BibTeX Entry:

  @inproceedings{Senturk2012,
 abstract = {Meaning crossword of sound, Crossole is a musical meta-instrument where the music is visualized as a set of virtual blocks that resemble a crossword puzzle. In Crossole, the chord progressions are visually presented as a set of virtual blocks. With the aid of the Kinect sensing technology, a performer controls music by manipulating the crossword blocks using hand movements. The performer can build chords in the high level, traverse over the blocks, step into the low level to control the chord arpeggiations note by note, loop a chord progression or map gestures to various processing algorithms to enhance the timbral scenery.},
 address = {Ann Arbor, Michigan},
 author = {Sertan \c{S}ent\"{u}rk and Sang Won Lee and Avinash Sastry and Anosh Daruwalla and Gil Weinberg},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178201},
 issn = {2220-4806},
 keywords = {Kinect, meta-instrument, chord progression, body gesture},
 publisher = {University of Michigan},
 title = {Crossole: A Gestural Interface for Composition, Improvisation and Performance using Kinect},
 url = {http://www.nime.org/proceedings/2012/nime2012_185.pdf},
 year = {2012}
}