VR Open Scores: Scores as Inspiration for VR Scenarios

Raul Masu, Paulo Bala, Muhammad Ahmad, Nuno N. Correia, Valentina Nisi, Nuno Nunes, and Teresa Romão

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper, we introduce the concept of VR Open Scores: aleatoric score-based virtual scenarios where an aleatoric score is embedded in a virtual environment. This idea builds upon the notion of graphic scores and composed instrument, and apply them in a new context. Our proposal also explores possible parallels between open meaning in interaction design, and aleatoric score, conceptualized as Open Work by the Italian philosopher Umberto Eco. Our approach has two aims. The first aim is to create an environment where users can immerse themselves in the visual elements of a score while listening to the corresponding music. The second aim is to facilitate users to develop a personal relationship with both the system and the score. To achieve those aims, as a practical implementation of our proposed concept, we developed two immersive scenarios: a 360º video and an interactive space. We conclude presenting how our design aims were accomplished in the two scenarios, and describing positive and negative elements of our implementations.

Citation:

Raul Masu, Paulo Bala, Muhammad Ahmad, Nuno N. Correia, Valentina Nisi, Nuno Nunes, and Teresa Romão. 2020. VR Open Scores: Scores as Inspiration for VR Scenarios. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.4813262

BibTeX Entry:

  @inproceedings{NIME20_21,
 abstract = {In this paper, we introduce the concept of VR Open Scores: aleatoric score-based virtual scenarios where an aleatoric score is embedded in a virtual environment. This idea builds upon the notion of graphic scores and composed instrument, and apply them in a new context. Our proposal also explores possible parallels between open meaning in interaction design, and aleatoric score, conceptualized as Open Work by the Italian philosopher Umberto Eco. Our approach has two aims. The first aim is to create an environment where users can immerse themselves in the visual elements of a score while listening to the corresponding music. The second aim is to facilitate users to develop a personal relationship with both the system and the score. To achieve those aims, as a practical implementation of our proposed concept, we developed two immersive scenarios: a 360º video and an interactive space. We conclude presenting how our design aims were accomplished in the two scenarios, and describing positive and negative elements of our implementations.},
 address = {Birmingham, UK},
 author = {Masu, Raul and Bala, Paulo and Ahmad, Muhammad and Correia, Nuno N. and Nisi, Valentina and Nunes, Nuno and Romão, Teresa},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.4813262},
 editor = {Romain Michon and Franziska Schroeder},
 issn = {2220-4806},
 month = {July},
 pages = {109--114},
 presentation-video = {https://youtu.be/JSM6Rydz7iE},
 publisher = {Birmingham City University},
 title = {VR Open Scores: Scores as Inspiration for VR Scenarios},
 url = {https://www.nime.org/proceedings/2020/nime2020_paper21.pdf},
 year = {2020}
}