residUUm: user mapping and performance strategies for multilayered live audiovisual generation

Ireti Olowe, Giulio Moro, and Mathieu Barthet

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

We propose residUUm, an audiovisual performance tool that uses sonification to orchestrate a particle system of shapes, as an attempt to build an audiovisual user interface in which all the actions of a performer on a laptop are intended to be explicitly interpreted by the audience. We propose two approaches to performing with residUUm and discuss the methods utilized to fulfill the promise of audience-visible interaction: mapping and performance strategies applied to express audiovisual interactions with multilayered sound-image relationships. The system received positive feedback from 34 audience participants on aspects such as aesthetics and audiovisual integration, and we identified further design challenges around performance clarity and strategy. We discuss residUUm's development objectives, modes of interaction and the impact of an audience-visible interface on the performer and observer.

Citation:

Ireti Olowe, Giulio Moro, and Mathieu Barthet. 2016. residUUm: user mapping and performance strategies for multilayered live audiovisual generation. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176098

BibTeX Entry:

  @inproceedings{Olowe2016,
 abstract = {We propose residUUm, an audiovisual performance tool that uses
sonification to orchestrate a particle system of shapes, as an attempt to build
an audiovisual user interface in which all the actions of a performer on a laptop
are intended to be explicitly interpreted by the audience. We propose two
approaches to performing with residUUm and discuss the methods utilized to
fulfill the promise of audience-visible interaction: mapping and performance
strategies applied to express audiovisual interactions with multilayered
sound-image relationships. The system received positive feedback from 34 audience
participants on aspects such as aesthetics and audiovisual integration, and we
identified further design challenges around performance clarity and strategy. We
discuss residUUm's development objectives, modes of interaction and the impact of
an audience-visible interface on the performer and observer. },
 address = {Brisbane, Australia},
 author = {Ireti Olowe and Giulio Moro and Mathieu Barthet},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176098},
 isbn = {978-1-925455-13-7},
 issn = {2220-4806},
 pages = {271--276},
 publisher = {Queensland Conservatorium Griffith University},
 title = {residUUm: user mapping and performance strategies for multilayered live audiovisual generation},
 track = {Papers},
 url = {http://www.nime.org/proceedings/2016/nime2016_paper0053.pdf},
 year = {2016}
}