Exploration of the Correspondence between Visual and Acoustic Parameter Spaces

David Gerhard, Daryl Hepting, and Matthew Mckague

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper describes an approach to match visual and acoustic parameters to produce an animated musical expression.Music may be generated to correspond to animation, asdescribed here; imagery may be created to correspond tomusic; or both may be developed simultaneously. This approach is intended to provide new tools to facilitate bothcollaboration between visual artists and musicians and examination of perceptual issues between visual and acousticmedia. As a proof-of-concept, a complete example is developed with linear fractals as a basis for the animation, andarranged rhythmic loops for the music. Since both visualand acoustic elements in the example are generated fromconcise specifications, the potential of this approach to create new works through parameter space exploration is accentuated, however, there are opportunities for applicationto a wide variety of source material. These additional applications are also discussed, along with issues encounteredin development of the example.

Citation:

David Gerhard, Daryl Hepting, and Matthew Mckague. 2004. Exploration of the Correspondence between Visual and Acoustic Parameter Spaces. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176603

BibTeX Entry:

  @inproceedings{Gerhard2004,
 abstract = {This paper describes an approach to match visual and acoustic parameters to produce an animated musical expression.Music may be generated to correspond to animation, asdescribed here; imagery may be created to correspond tomusic; or both may be developed simultaneously. This approach is intended to provide new tools to facilitate bothcollaboration between visual artists and musicians and examination of perceptual issues between visual and acousticmedia. As a proof-of-concept, a complete example is developed with linear fractals as a basis for the animation, andarranged rhythmic loops for the music. Since both visualand acoustic elements in the example are generated fromconcise specifications, the potential of this approach to create new works through parameter space exploration is accentuated, however, there are opportunities for applicationto a wide variety of source material. These additional applications are also discussed, along with issues encounteredin development of the example.},
 address = {Hamamatsu, Japan},
 author = {Gerhard, David and Hepting, Daryl and Mckague, Matthew},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176603},
 issn = {2220-4806},
 keywords = {Multimedia creation and interaction, parameter space, visualization, sonification.},
 pages = {96--99},
 title = {Exploration of the Correspondence between Visual and Acoustic Parameter Spaces},
 url = {http://www.nime.org/proceedings/2004/nime2004_096.pdf},
 year = {2004}
}