Interactive Spatialization and Sound Design using an Evolutionary System

Jose Fornari, Adolfo Jr. Maia, and Jonatas Manzolli

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

We present an interactive sound spatialization and synthesis system based on Interaural Time Difference (ITD) model and Evolutionary Computation. We define a Sonic Localization Field using sound attenuation and ITD azimuth angle parameters and, in order to control an adaptive algorithm, we used pairs of these parameters as Spatial Sound Genotypes (SSG). They are extracted from waveforms which are considered individuals of a Population Set. A user-interface receives input from a generic gesture interface (such as a NIME device) and interprets them as ITD cues. Trajectories provided by these signals are used as Target Sets of an evolutionary algorithm. A Fitness procedure optimizes locally the distance between the Target Set and the SSG pairs. Through a parametric score the user controls dynamic changes in the sound output.

Citation:

Jose Fornari, Adolfo Jr. Maia, and Jonatas Manzolli. 2007. Interactive Spatialization and Sound Design using an Evolutionary System. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177089

BibTeX Entry:

  @inproceedings{Fornari2007,
 abstract = {We present an interactive sound spatialization and synthesis system based on Interaural Time Difference (ITD) model and Evolutionary Computation. We define a Sonic Localization Field using sound attenuation and ITD azimuth angle parameters and, in order to control an adaptive algorithm, we used pairs of these parameters as Spatial Sound Genotypes (SSG). They are extracted from waveforms which are considered individuals of a Population Set. A user-interface receives input from a generic gesture interface (such as a NIME device) and interprets them as ITD cues. Trajectories provided by these signals are used as Target Sets of an evolutionary algorithm. A Fitness procedure optimizes locally the distance between the Target Set and the SSG pairs. Through a parametric score the user controls dynamic changes in the sound output. },
 address = {New York City, NY, United States},
 author = {Fornari, Jose and Maia, Adolfo Jr. and Manzolli, Jonatas},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177089},
 issn = {2220-4806},
 keywords = {interactive, sound, spatialization, evolutionary, adaptation. },
 pages = {293--298},
 title = {Interactive Spatialization and Sound Design using an Evolutionary System},
 url = {http://www.nime.org/proceedings/2007/nime2007_293.pdf},
 year = {2007}
}