An Interface for Emotional Expression in Audio-Visuals

Kamer Ali Yuksel, Sinan Buyukbas, and Elif Ayiter

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this work, a comprehensive study is performed on the relationship between audio, visual and emotion by applying the principles of cognitive emotion theory into digital creation. The study is driven by an audiovisual emotion library project that is named AVIEM, which provides an interactive interface for experimentation and evaluation of the perception and creation processes of audiovisuals. AVIEM primarily consists of separate audio and visual libraries and grows with user contribution as users explore different combinations between them. The library provides a wide range of experimentation possibilities by allowing users to create audiovisual relations and logging their emotional responses through its interface. Besides being a resourceful tool of experimentation, AVIEM aims to become a source of inspiration, where digitally created abstract virtual environments and soundscapes can elicit target emotions at a preconscious level, by building genuine audiovisual relations that would engage the viewer on a strong emotional stage. Lastly, various schemes are proposed to visualize information extracted through AVIEM, to improve the navigation and designate the trends and dependencies among audiovisual relations.

Citation:

Kamer Ali Yuksel, Sinan Buyukbas, and Elif Ayiter. 2012. An Interface for Emotional Expression in Audio-Visuals. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178457

BibTeX Entry:

  @inproceedings{Yuksel2012,
 abstract = {In this work, a comprehensive study is performed on the relationship between audio, visual and emotion by applying the principles of cognitive emotion theory into digital creation. The study is driven by an audiovisual emotion library project that is named AVIEM, which provides an interactive interface for experimentation and evaluation of the perception and creation processes of audiovisuals. AVIEM primarily consists of separate audio and visual libraries and grows with user contribution as users explore different combinations between them. The library provides a wide range of experimentation possibilities by allowing users to create audiovisual relations and logging their emotional responses through its interface. Besides being a resourceful tool of experimentation, AVIEM aims to become a source of inspiration, where digitally created abstract virtual environments and soundscapes can elicit target emotions at a preconscious level, by building genuine audiovisual relations that would engage the viewer on a strong emotional stage. Lastly, various schemes are proposed to visualize information extracted through AVIEM, to improve the navigation and designate the trends and dependencies among audiovisual relations.},
 address = {Ann Arbor, Michigan},
 author = {Kamer Ali Yuksel and Sinan Buyukbas and Elif Ayiter},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178457},
 issn = {2220-4806},
 keywords = {Designing emotive audiovisuals, cognitive emotion theory, audiovisual perception and interaction, synaesthesia},
 publisher = {University of Michigan},
 title = {An Interface for Emotional Expression in Audio-Visuals},
 url = {http://www.nime.org/proceedings/2012/nime2012_60.pdf},
 year = {2012}
}