Eaves Verse

Shunhang Huang

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Eaves Verse is an interactive audiovisual performance created for Media Pipe and AI real-time image generation. Centered around the cultural symbol of the eaves in traditional Chinese architecture, the performance begins with the creator's intent, using hand gestures as an interactive medium. Leveraging AI real-time image generation technology, it presents a three-tiered progression: from abstract concepts to AI-constructed concrete visuals, culminating in an aesthetic realm where reality and illusion intertwine. The lingering melodies of Eastern resonance naturally intertwine with the natural cadence of spoken phrases, while the texture of electronic rhythms synchronously resonates with interactive movements. This allows traditional sonic rhythms to flow within a contemporary interactive context, evoking an Eastern auditory essence where reality and illusion merge. In this work, AI transcends its role as a mere technical tool to become a “symbiotic partner” attuned to the creator's intent. It generates visuals in real time in response to gestures, transforming thoughts into tangible forms. Through this novel interactive format, it reconstructs the contemporary expression of traditional aesthetics, ultimately crafting an audiovisual experience that embodies the interplay of reality and illusion–a quintessential Eastern aesthetic.

Citation

Shunhang Huang. 2026. Eaves Verse. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.20782065 [PDF]

BibTeX Entry

@inproceedings{nime2026_music_13,
 abstract = {Eaves Verse is an interactive audiovisual performance created for Media Pipe and AI real-time image generation. Centered around the cultural symbol of the eaves in traditional Chinese architecture, the performance begins with the creator's intent, using hand gestures as an interactive medium. Leveraging AI real-time image generation technology, it presents a three-tiered progression: from abstract concepts to AI-constructed concrete visuals, culminating in an aesthetic realm where reality and illusion intertwine. The lingering melodies of Eastern resonance naturally intertwine with the natural cadence of spoken phrases, while the texture of electronic rhythms synchronously resonates with interactive movements. This allows traditional sonic rhythms to flow within a contemporary interactive context, evoking an Eastern auditory essence where reality and illusion merge. In this work, AI transcends its role as a mere technical tool to become a “symbiotic partner” attuned to the creator's intent. It generates visuals in real time in response to gestures, transforming thoughts into tangible forms. Through this novel interactive format, it reconstructs the contemporary expression of traditional aesthetics, ultimately crafting an audiovisual experience that embodies the interplay of reality and illusion–a quintessential Eastern aesthetic.},
 address = {London, United Kingdom},
 articleno = {13},
 author = {Shunhang Huang},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.20782065},
 editor = {Lia Mice and Nicole Robson and Tara Pattenden},
 issn = {2220-4806},
 month = {June},
 note = {Remote Performance},
 numpages = {4},
 pages = {46--49},
 presentation-video = {https://www.youtube.com/watch?v=rrb-tWrjJ8M},
 title = {Eaves Verse},
 track = {Music},
 url = {http://nime.org/proceedings/2026/nime2026_music_13.pdf},
 year = {2026}
}