Towards Mapping Timbre to Emotional Affect

Niklas Klügel, and Georg Groh

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Controlling the timbre generated by an audio synthesizerin a goal-oriented way requires a profound understandingof the synthesizer's manifold structural parameters. Especially shapingtimbre expressively to communicate emotional affect requires expertise.Therefore, novices in particular may not be able to adequately control timbrein viewof articulating the wealth of affects musically. In this context, the focus ofthis paper is the development of a model that can represent a relationshipbetween timbre and an expected emotional affect . The results of the evaluationof the presented model are encouraging which supports its use in steering oraugmenting the control of the audio synthesis. We explicitly envision thispaper as a contribution to the field of Synthesis by Analysis in the broadersense, albeit being potentially suitable to other related domains.

Citation:

Niklas Klügel, and Georg Groh. 2013. Towards Mapping Timbre to Emotional Affect. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178586

BibTeX Entry:

  @inproceedings{Klugel2013,
 abstract = {Controlling the timbre generated by an audio synthesizerin a goal-oriented way requires a profound understandingof the synthesizer's manifold structural parameters. Especially shapingtimbre expressively to communicate emotional affect requires expertise.Therefore, novices in particular may not be able to adequately control timbrein viewof articulating the wealth of affects musically. In this context, the focus ofthis paper is the development of a model that can represent a relationshipbetween timbre and an expected emotional affect . The results of the evaluationof the presented model are encouraging which supports its use in steering oraugmenting the control of the audio synthesis. We explicitly envision thispaper as a contribution to the field of Synthesis by Analysis in the broadersense, albeit being potentially suitable to other related domains.},
 address = {Daejeon, Republic of Korea},
 author = {Niklas Kl{\"u}gel and Georg Groh},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178586},
 issn = {2220-4806},
 keywords = {Emotional affect,Timbre, Machine Learning, Deep Belief Networks, Analysis by Synthesis},
 month = {May},
 pages = {525--530},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Towards Mapping Timbre to Emotional Affect},
 url = {http://www.nime.org/proceedings/2013/nime2013_23.pdf},
 year = {2013}
}