Hyper-shaku (Border-crossing): Towards the Multi-modal Gesture-controlled Hyper-Instrument

Kirsty Beilharz, Joanne Jakovich, and Sam Ferguson

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Hyper-shaku (Border-Crossing) is an interactive sensor environment that uses motion sensors to trigger immediate responses and generative processes augmenting the Japanese bamboo shakuhachi in both the auditory and visual domain. The latter differentiates this process from many hyper-instruments by building a performance of visual design as well as electronic music on top of the acoustic performance. It utilizes a combination of computer vision and wireless sensing technologies conflated from preceding works. This paper outlines the use of gesture in these preparatory sound and audio-visual performative, installation and sonification works, leading to a description of the Hyper-shaku environment integrating sonification and generative elements.

Citation:

Kirsty Beilharz, Joanne Jakovich, and Sam Ferguson. 2006. Hyper-shaku (Border-crossing): Towards the Multi-modal Gesture-controlled Hyper-Instrument. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176867

BibTeX Entry:

  @inproceedings{Beilharz2006,
 abstract = {Hyper-shaku (Border-Crossing) is an interactive sensor environment that uses motion sensors to trigger immediate responses and generative processes augmenting the Japanese bamboo shakuhachi in both the auditory and visual domain. The latter differentiates this process from many hyper-instruments by building a performance of visual design as well as electronic music on top of the acoustic performance. It utilizes a combination of computer vision and wireless sensing technologies conflated from preceding works. This paper outlines the use of gesture in these preparatory sound and audio-visual performative, installation and sonification works, leading to a description of the Hyper-shaku environment integrating sonification and generative elements. },
 address = {Paris, France},
 author = {Beilharz, Kirsty and Jakovich, Joanne and Ferguson, Sam},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176867},
 issn = {2220-4806},
 keywords = {Gesture-controllers, sonification, hyper-instrument },
 pages = {352--357},
 title = {Hyper-shaku (Border-crossing): Towards the Multi-modal Gesture-controlled Hyper-Instrument},
 url = {http://www.nime.org/proceedings/2006/nime2006_352.pdf},
 year = {2006}
}