Experiments with Virtual Reality Instruments

Teemu Mäki-patola, Juha Laitinen, Aki Kanerva, and Tapio Takala

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper, we introduce and analyze four gesture-controlled musical instruments. We briefly discuss the test platform designed to allow for rapid experimentation of new interfaces and control mappings. We describe our design experiences and discuss the effects of system features such as latency, resolution and lack of tactile feedback. The instruments use virtual reality hardware and computer vision for user input, and three-dimensional stereo vision as well as simple desktop displays for providing visual feedback. The instrument sounds are synthesized in real-time using physical sound modeling.

Citation:

Teemu Mäki-patola, Juha Laitinen, Aki Kanerva, and Tapio Takala. 2005. Experiments with Virtual Reality Instruments. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176780

BibTeX Entry:

  @inproceedings{Makipatola2005,
 abstract = {In this paper, we introduce and analyze four gesture-controlled musical instruments. We briefly discuss the test platform designed to allow for rapid experimentation of new interfaces and control mappings. We describe our design experiences and discuss the effects of system features such as latency, resolution and lack of tactile feedback. The instruments use virtual reality hardware and computer vision for user input, and three-dimensional stereo vision as well as simple desktop displays for providing visual feedback. The instrument sounds are synthesized in real-time using physical sound modeling. },
 address = {Vancouver, BC, Canada},
 author = {M\''{a}ki-patola, Teemu and Laitinen, Juha and Kanerva, Aki and Takala, Tapio},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176780},
 issn = {2220-4806},
 keywords = {Musical instrument design, virtual instrument, gesture, widgets, physical sound modeling, control mapping.},
 pages = {11--16},
 title = {Experiments with Virtual Reality Instruments},
 url = {http://www.nime.org/proceedings/2005/nime2005_011.pdf},
 year = {2005}
}