Study for virtual keyboard instrument and hand tracking in a VR environment

Alex Hofmann

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This sound installation explores the non-physicality of virtual environments and their impact on interactions with virtual musical instruments. Using hand-tracking technology, visitors of this virtual reality (VR) sound installation can play a virtual keyboard instrument displayed via a head-mounted display. Following an experimental approach to contemporary piano music, in this installation the entire instrument behaves differently compared to the real world. Due to the virtual-physical system, the expected quickly transforms into the unexpected. The implications of an instrument with free-floating keys that produce sound when they collide are to be explored by the visitors.

Citation

Alex Hofmann. 2021. Study for virtual keyboard instrument and hand tracking in a VR environment. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.21428/92fbeb44.2e31abfe [PDF]

BibTeX Entry

@inproceedings{nime2021_installations_3,
 abstract = {This sound installation explores the non-physicality of virtual environments and their impact on interactions with virtual musical instruments. Using hand-tracking technology, visitors of this virtual reality (VR) sound installation can play a virtual keyboard instrument displayed via a head-mounted display. Following an experimental approach to contemporary piano music, in this installation the entire instrument behaves differently compared to the real world. Due to the virtual-physical system, the expected quickly transforms into the unexpected. The implications of an instrument with free-floating keys that produce sound when they collide are to be explored by the visitors.},
 address = {Shanghai, China},
 articleno = {3},
 author = {Alex Hofmann},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.2e31abfe},
 editor = {Rodolfo Cossovich and Demi Li},
 issn = {2220-4806},
 month = {June},
 title = {Study for virtual keyboard instrument and hand tracking in a VR environment},
 track = {Installations},
 url = {https://doi.org/10.21428/92fbeb44.2e31abfe},
 year = {2021}
}