Experiments with Virtual Reality Instruments

Teemu Mäki-patola, Juha Laitinen, Aki Kanerva, and Tapio Takala

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2005
• Location: Vancouver, BC, Canada
• Pages: 11–16
• Keywords: Musical instrument design, virtual instrument, gesture, widgets, physical sound modeling, control mapping.
• DOI: 10.5281/zenodo.1176780 (Link to paper)
• PDF link

Abstract:

In this paper, we introduce and analyze four gesture-controlled musical instruments. We briefly discuss the test platform designed to allow for rapid experimentation of new interfaces and control mappings. We describe our design experiences and discuss the effects of system features such as latency, resolution and lack of tactile feedback. The instruments use virtual reality hardware and computer vision for user input, and three-dimensional stereo vision as well as simple desktop displays for providing visual feedback. The instrument sounds are synthesized in real-time using physical sound modeling.

Citation:

BibTeX Entry:

  @inproceedings{Makipatola2005,
 abstract = {In this paper, we introduce and analyze four gesture-controlled musical instruments. We briefly discuss the test platform designed to allow for rapid experimentation of new interfaces and control mappings. We describe our design experiences and discuss the effects of system features such as latency, resolution and lack of tactile feedback. The instruments use virtual reality hardware and computer vision for user input, and three-dimensional stereo vision as well as simple desktop displays for providing visual feedback. The instrument sounds are synthesized in real-time using physical sound modeling. },
 address = {Vancouver, BC, Canada},
 author = {M\''{a}ki-patola, Teemu and Laitinen, Juha and Kanerva, Aki and Takala, Tapio},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176780},
 issn = {2220-4806},
 keywords = {Musical instrument design, virtual instrument, gesture, widgets, physical sound modeling, control mapping.},
 pages = {11--16},
 title = {Experiments with Virtual Reality Instruments},
 url = {http://www.nime.org/proceedings/2005/nime2005_011.pdf},
 year = {2005}
}