Images as Spatial Sound Maps

Etienne Deleflie, and Greg Schiemer

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The tools for spatial composition typically model just a small subset of the spatial audio cues known to researchers. As composers explore this medium it has become evident that the nature of spatial sound perception is complex. Yet interfaces for spatial composition are often simplistic and the end results can be disappointing. This paper presents an interface that is designed to liberate the composer from thinking of spatialised sound as points in space. Instead, visual images are used to define sound in terms of shape, size and location. Images can be sequenced into video, thereby creating rich and complex temporal soundscapes. The interface offers both the ability to craft soundscapes and also compose their evolution in time.

Citation:

Etienne Deleflie, and Greg Schiemer. 2010. Images as Spatial Sound Maps. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177753

BibTeX Entry:

  @inproceedings{Deleflie2010,
 abstract = {The tools for spatial composition typically model just a small subset of the spatial audio cues known to researchers. As composers explore this medium it has become evident that the nature of spatial sound perception is complex. Yet interfaces for spatial composition are often simplistic and the end results can be disappointing. This paper presents an interface that is designed to liberate the composer from thinking of spatialised sound as points in space. Instead, visual images are used to define sound in terms of shape, size and location. Images can be sequenced into video, thereby creating rich and complex temporal soundscapes. The interface offers both the ability to craft soundscapes and also compose their evolution in time. },
 address = {Sydney, Australia},
 author = {Deleflie, Etienne and Schiemer, Greg},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177753},
 issn = {2220-4806},
 keywords = {Spatial audio, surround sound, ambisonics, granular synthesis, decorrelation, diffusion.},
 pages = {130--135},
 title = {Images as Spatial Sound Maps},
 url = {http://www.nime.org/proceedings/2010/nime2010_130.pdf},
 year = {2010}
}