Playful Audio-Visual Interaction with Spheroids

Yuma Ikawa, and Akihiro Matsuura

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper presents a novel interactive system for creating audio-visual expressions on tabletop display by dynamically manipulating solids of revolution called spheroids. The four types of basic spinning and rolling movements of spheroids are recognized from the physical conditions such as the contact area, the location of the centroid, the (angular) velocity, and the curvature of the locus all obtained from sensor data on the display. They are then used for interactively generating audio-visual effects that match each of the movements. We developed a digital content that integrated these functionalities and enabled composition and live performance through manipulation of spheroids.

Citation:

Yuma Ikawa, and Akihiro Matsuura. 2020. Playful Audio-Visual Interaction with Spheroids . Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.4813311

BibTeX Entry:

  @inproceedings{NIME20_36,
 abstract = {This paper presents a novel interactive system for creating audio-visual expressions on tabletop display by dynamically manipulating solids of revolution called spheroids. The four types of basic spinning and rolling movements of spheroids are recognized from the physical conditions such as the contact area, the location of the centroid, the (angular) velocity, and the curvature of the locus all obtained from sensor data on the display. They are then used for interactively generating audio-visual effects that match each of the movements. We developed a digital content that integrated these functionalities and enabled composition and live performance through manipulation of spheroids.},
 address = {Birmingham, UK},
 author = {Ikawa, Yuma and Matsuura, Akihiro},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.4813311},
 editor = {Romain Michon and Franziska Schroeder},
 issn = {2220-4806},
 month = {July},
 pages = {188--189},
 publisher = {Birmingham City University},
 title = {Playful Audio-Visual Interaction with Spheroids },
 url = {https://www.nime.org/proceedings/2020/nime2020_paper36.pdf},
 year = {2020}
}