Satie: A Creativity Support Tool for Authoring Spatial Generative Audio

Mateo Larrea, Richard Boulanger, Yuhao Zhang, Jerry Chen, and Pedro Sodre

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Composers and sound designers working in immersive spatial audio often face a gap between creative intent and implementation. Core behaviors such as stochastic timing, per-event parameter variation, and smooth 3D motion are conceptually simple but require substantial programming in a game engine or DAW. Generative AI can help: large language models can produce code, and audio-generation models can synthesize material from text prompts. However, these outputs are often opaque and difficult to revise. We present Satie, a creativity support tool that lets designers use generative AI while retaining authorship. Satie is built around an audio-first domain-specific language whose keywords reflect sound design vocabulary (e.g., volume, pitch, fade, move fly). The language is plain text with a line-per-property structure, acting as a shared interface between the designer and AI: an LLM can generate Satie code, the runtime can generate audio from embedded text prompts via the gen keyword, and the same mechanism can define procedural spatial motion. Designers can read, understand, and modify individual properties without unintended side effects. Satie runs as an interpreted layer in a web application using the Web Audio API, supporting live editing and real-time visualization of sound trajectories. Sketches can be saved, forked, and shared, and gen statements resolve against a community sample library before falling back to synthesis. We demonstrate Satie through immersive scenes, compositions, and live coding scripts, and evaluate expressivity through code comparisons and informal designer feedback.

Citation

Mateo Larrea, Richard Boulanger, Yuhao Zhang, Jerry Chen, and Pedro Sodre. 2026. Satie: A Creativity Support Tool for Authoring Spatial Generative Audio. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.20784472 [PDF]

BibTeX Entry

@inproceedings{nime2026_157,
 abstract = {Composers and sound designers working in immersive spatial audio often face a gap between creative intent and implementation. Core behaviors such as stochastic timing, per-event parameter variation, and smooth 3D motion are conceptually simple but require substantial programming in a game engine or DAW. Generative AI can help: large language models can produce code, and audio-generation models can synthesize material from text prompts. However, these outputs are often opaque and difficult to revise. We present Satie, a creativity support tool that lets designers use generative AI while retaining authorship. Satie is built around an audio-first domain-specific language whose keywords reflect sound design vocabulary (e.g., volume, pitch, fade, move fly). The language is plain text with a line-per-property structure, acting as a shared interface between the designer and AI: an LLM can generate Satie code, the runtime can generate audio from embedded text prompts via the gen keyword, and the same mechanism can define procedural spatial motion. Designers can read, understand, and modify individual properties without unintended side effects. Satie runs as an interpreted layer in a web application using the Web Audio API, supporting live editing and real-time visualization of sound trajectories. Sketches can be saved, forked, and shared, and gen statements resolve against a community sample library before falling back to synthesis. We demonstrate Satie through immersive scenes, compositions, and live coding scripts, and evaluate expressivity through code comparisons and informal designer feedback.},
 address = {London, United Kingdom},
 articleno = {157},
 author = {Mateo Larrea and Richard Boulanger and Yuhao Zhang and Jerry Chen and Pedro Sodre},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.20784472},
 editor = {Benedict Gaster and João Tragtenberg and Anna Xambó and Tom Mitchell},
 issn = {2220-4806},
 month = {June},
 note = {},
 numpages = {11},
 pages = {1267--1277},
 title = {Satie: A Creativity Support Tool for Authoring Spatial Generative Audio},
 track = {paper},
 url = {http://nime.org/proceedings/2026/nime2026_157.pdf},
 year = {2026}
}