YouTube Mirror

Sihwa Park

Installation Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2023
• Location: Mexico City, Mexico
• Article Number: 1289
• DOI: 10.5281/zenodo.11194818 (Link to paper)
• PDF link

Abstract:

YouTube Mirror is an interactive, audiovisual AI installation that generates images and sounds in response to the images of the audience captured through a camera in real time as a concept of data mirror. YouTube Mirror uses a cross-modal generative machine model that was trained in an unsupervised way to learn the association between images and sounds obtained from the YouTube videos I watched. The machine will see the world only based on this audio-visual relationship, and the audience can see themselves through the machine-generated images and sounds. YouTube Mirror is an artistic attempt to simulate my unconscious, implicit understanding of audio-visual relationships that can be found in and limited by the videos I watched. YouTube Mirror also attempts to represent the possibility of the machine's bias caused by implicit bias inherent in video recommendation algorithms as well as a small set of personal data.

Citation:

BibTeX Entry:

  @article{nime23-installations-1289,
 abstract = {YouTube Mirror is an interactive, audiovisual AI installation that generates images and sounds in response to the images of the audience captured through a camera in real time as a concept of data mirror. YouTube Mirror uses a cross-modal generative machine model that was trained in an unsupervised way to learn the association between images and sounds obtained from the YouTube videos I watched. The machine will see the world only based on this audio-visual relationship, and the audience can see themselves through the machine-generated images and sounds. YouTube Mirror is an artistic attempt to simulate my unconscious, implicit understanding of audio-visual relationships that can be found in and limited by the videos I watched. YouTube Mirror also attempts to represent the possibility of the machine's bias caused by implicit bias inherent in video recommendation algorithms as well as a small set of personal data.},
 address = {Mexico City, Mexico},
 articleno = {1289},
 author = {Sihwa Park},
 booktitle = {Installation Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.11194818},
 editor = {Salvador Chavez and Tito Rivas},
 month = {May},
 title = {YouTube Mirror},
 url = {https://www.nime.org/proceedings/2023/nime2023_installations_1289.pdf},
 year = {2023}
}