Drawing Space with Rain: The Umbrella as a Flow Interface

Kana Yamaguchi, Yuga Tsukuda, and Yoichi Ochiai

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This study explores new possibilities for transforming perceived space by using an umbrella as a dynamic spatial auditory interface. While spatial audio technologies have been widely applied across various domains, there are few opportunities in daily life to consciously perceive the boundary between personal and external space. Due to its physical structure and everyday usage, the umbrella has a unique ability to render such boundaries perceptible.Focusing on the “flow” of raindrops across the umbrella’s surface, the system detects continuous rain movement in real time rather than merely capturing impact sounds. Spatial auditory feedback encourages users to actively perceive dynamic spatial boundaries, as the rain draws auditory contours through interaction with the umbrella.To this end, the umbrella is conceptualized as an interactive interface that senses raindrop movement and applies spatial audio processing. In addition, users can dynamically alter the virtual size of the umbrella, enabling perceptual shifts in spatial scale.Rather than treating the umbrella as a mere protective object, this system reimagines it as a medium for perceiving environmental change through sound. By integrating natural phenomena with spatial audio, this approach suggests new directions for embodied perception and expression.

Citation

Kana Yamaguchi, Yuga Tsukuda, and Yoichi Ochiai. 2025. Drawing Space with Rain: The Umbrella as a Flow Interface. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.15699671 [PDF]

BibTeX Entry

@article{nime2025_96,
 abstract = {This study explores new possibilities for transforming perceived space by using an umbrella as a dynamic spatial auditory interface. While spatial audio technologies have been widely applied across various domains, there are few opportunities in daily life to consciously perceive the boundary between personal and external space. Due to its physical structure and everyday usage, the umbrella has a unique ability to render such boundaries perceptible.Focusing on the “flow” of raindrops across the umbrella’s surface, the system detects continuous rain movement in real time rather than merely capturing impact sounds. Spatial auditory feedback encourages users to actively perceive dynamic spatial boundaries, as the rain draws auditory contours through interaction with the umbrella.To this end, the umbrella is conceptualized as an interactive interface that senses raindrop movement and applies spatial audio processing. In addition, users can dynamically alter the virtual size of the umbrella, enabling perceptual shifts in spatial scale.Rather than treating the umbrella as a mere protective object, this system reimagines it as a medium for perceiving environmental change through sound. By integrating natural phenomena with spatial audio, this approach suggests new directions for embodied perception and expression.},
 address = {Canberra, Australia},
 articleno = {96},
 author = {Kana Yamaguchi and Yuga Tsukuda and Yoichi Ochiai},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.15699671},
 editor = {Doga Cavdir and Florent Berthaut},
 issn = {2220-4806},
 month = {June},
 numpages = {8},
 pages = {650--657},
 title = {Drawing Space with Rain: The Umbrella as a Flow Interface},
 track = {Paper},
 url = {http://nime.org/proceedings/2025/nime2025_96.pdf},
 year = {2025}
}