Bug

Ryo Ikeshiro

Installation Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2023
• Location: Mexico City, Mexico
• Article Number: 57
• DOI: 10.5281/zenodo.11194794 (Link to paper)
• PDF link

Abstract:

Bug demonstrates the potential of sound event recognition (SER) in locating insect-like noises or socially undesirable elements by navigating through spatial audio (Ambisonics) field recordings. It is a commentary on the increasing development of audio technologies with uses in entertainment and advertising, as well as in surveillance, law enforcement and the military.
In bug, an algorithm scans through spatial audio captured at urban environments in Hong Kong. Field recordings of Cantonese dialects, South-East Asian languages, Asian music and wildlife are analysed, pursuing insect-like sounds. They are then made audible by parametric speakers emitting modulated ultrasound with a laser pointing in the same direction using a pan-tilt base and servo motors. The emitted ultrasound is highly directional, creating a “beam” of inaudible sound waves more similar to light than conventional audio. As the waves collide with the interior of the installation space and demodulated, audible sound emanates from the point on the wall, ceiling or floor at which they are reflected.

Citation:

BibTeX Entry:

  @article{nime23-installations-57,
 abstract = {Bug demonstrates the potential of sound event recognition (SER) in locating insect-like noises or socially undesirable elements by navigating through spatial audio (Ambisonics) field recordings. It is a commentary on the increasing development of audio technologies with uses in entertainment and advertising, as well as in surveillance, law enforcement and the military.
In bug, an algorithm scans through spatial audio captured at urban environments in Hong Kong. Field recordings of Cantonese dialects, South-East Asian languages, Asian music and wildlife are analysed, pursuing insect-like sounds. They are then made audible by parametric speakers emitting modulated ultrasound with a laser pointing in the same direction using a pan-tilt base and servo motors. The emitted ultrasound is highly directional, creating a “beam” of inaudible sound waves more similar to light than conventional audio. As the waves collide with the interior of the installation space and demodulated, audible sound emanates from the point on the wall, ceiling or floor at which they are reflected.},
 address = {Mexico City, Mexico},
 articleno = {57},
 author = {Ryo Ikeshiro},
 booktitle = {Installation Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.11194794},
 editor = {Salvador Chavez and Tito Rivas},
 month = {May},
 title = {Bug},
 url = {https://www.nime.org/proceedings/2023/nime2023_installations_57.pdf},
 year = {2023}
}