YouTube Mirror

Sihwa Park

Installation Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

YouTube Mirror is an interactive, audiovisual AI installation that generates images and sounds in response to the images of the audience captured through a camera in real time as a concept of data mirror. YouTube Mirror uses a cross-modal generative machine model that was trained in an unsupervised way to learn the association between images and sounds obtained from the YouTube videos I watched. The machine will see the world only based on this audio-visual relationship, and the audience can see themselves through the machine-generated images and sounds. YouTube Mirror is an artistic attempt to simulate my unconscious, implicit understanding of audio-visual relationships that can be found in and limited by the videos I watched. YouTube Mirror also attempts to represent the possibility of the machine's bias caused by implicit bias inherent in video recommendation algorithms as well as a small set of personal data.

Citation

Sihwa Park. 2023. YouTube Mirror. Installation Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.11194818

BibTeX Entry

@article{nime23-installations-1289,
 abstract = {YouTube Mirror is an interactive, audiovisual AI installation that generates images and sounds in response to the images of the audience captured through a camera in real time as a concept of data mirror. YouTube Mirror uses a cross-modal generative machine model that was trained in an unsupervised way to learn the association between images and sounds obtained from the YouTube videos I watched. The machine will see the world only based on this audio-visual relationship, and the audience can see themselves through the machine-generated images and sounds. YouTube Mirror is an artistic attempt to simulate my unconscious, implicit understanding of audio-visual relationships that can be found in and limited by the videos I watched. YouTube Mirror also attempts to represent the possibility of the machine's bias caused by implicit bias inherent in video recommendation algorithms as well as a small set of personal data.},
 address = {Mexico City, Mexico},
 articleno = {1289},
 author = {Sihwa Park},
 booktitle = {Installation Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.11194818},
 editor = {Salvador Chavez and Tito Rivas},
 month = {May},
 title = {YouTube Mirror},
 url = {https://www.nime.org/proceedings/2023/nime2023_installations_1289.pdf},
 year = {2023}
}