UnStumm - Artificial Liveness

Claudia Schmitz, and Nicola Leonard Hein

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

UnStumm - Artificial Liveness is run by Claudia Schmitz (time-based media artist) and Nicola L. Hein (sound artist) and focuses on the equal communication of human and machine actors within the framework of audiovisual real-time performances in telematic virtual reality settings. In UnStumm - Artificial Liveness, the boundaries between human and machine are blurred, forming an artificial system that unfolds an nonartificial liveness and questions the boundaries of human and machine through collaborative creation and real-time performance. The two project leaders (performing with moving image onto virtual sculpture and guitar/electronics respectively) will perform together with the two AI artists programmed by them. It will realize a virtual reality performance in front of an audience over a duration of 15 minutes. The intermedial and transhuman conversation between 2 video artists and 2 sound artists will take place on the virtual reality real-time platform already programmed by UnStumm, where humans and machine actors will meet as artistic partners. The machine artists will use technologies of machine learning in order to interact. The audience will be able to stream the performances through this internet platform and use their own smartphones as AR glasses to stream the AR performances visually and auditorily. Sound will be audible through headphones and a binaural audio stream.

Citation

Claudia Schmitz, and Nicola Leonard Hein. 2021. UnStumm - Artificial Liveness. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.21428/92fbeb44.a1d9cdc3 [PDF]

BibTeX Entry

@inproceedings{nime2021_music_26,
 abstract = {UnStumm - Artificial Liveness is run by Claudia Schmitz (time-based media artist) and Nicola L. Hein (sound artist) and focuses on the equal communication of human and machine actors within the framework of audiovisual real-time performances in telematic virtual reality settings. In UnStumm - Artificial Liveness, the boundaries between human and machine are blurred, forming an artificial system that unfolds an nonartificial liveness and questions the boundaries of human and machine through collaborative creation and real-time performance. The two project leaders (performing with moving image onto virtual sculpture and guitar/electronics respectively) will perform together with the two AI artists programmed by them. It will realize a virtual reality performance in front of an audience over a duration of 15 minutes. The intermedial and transhuman conversation between 2 video artists and 2 sound artists will take place on the virtual reality real-time platform already programmed by UnStumm, where humans and machine actors will meet as artistic partners. The machine artists will use technologies of machine learning in order to interact. The audience will be able to stream the performances through this internet platform and use their own smartphones as AR glasses to stream the AR performances visually and auditorily. Sound will be audible through headphones and a binaural audio stream.},
 address = {Shanghai, China},
 articleno = {26},
 author = {Claudia Schmitz and Nicola Leonard Hein},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.a1d9cdc3},
 editor = {Eric Parren and Wei Chen},
 issn = {2220-4806},
 month = {June},
 title = {UnStumm - Artificial Liveness},
 track = {Music},
 url = {https://doi.org/10.21428/92fbeb44.a1d9cdc3},
 year = {2021}
}