Words to Music Synthesis

Michael J Krzyzaniak

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2020
• Location: Birmingham, UK
• Pages: 29–34
• DOI: 10.5281/zenodo.4813350 (Link to paper)
• PDF link

Abstract:

This paper discusses the design of a musical synthesizer that takes words as input, and attempts to generate music that somehow underscores those words. This is considered as a tool for sound designers who could, for example, enter dialogue from a film script and generate appropriate back- ground music. The synthesizer uses emotional valence and arousal as a common representation between words and mu- sic. It draws on previous studies that relate words and mu- sical features to valence and arousal. The synthesizer was evaluated with a user study. Participants listened to music generated by the synthesizer, and described the music with words. The arousal of the words they entered was highly correlated with the intended arousal of the music. The same was, surprisingly, not true for valence. The synthesizer is online, at [redacted URL].

Citation:

BibTeX Entry:

  @inproceedings{NIME20_5,
 abstract = {This paper discusses the design of a musical synthesizer that takes words as input, and attempts to generate music that somehow underscores those words. This is considered as a tool for sound designers who could, for example, enter dialogue from a film script and generate appropriate back- ground music. The synthesizer uses emotional valence and arousal as a common representation between words and mu- sic. It draws on previous studies that relate words and mu- sical features to valence and arousal. The synthesizer was evaluated with a user study. Participants listened to music generated by the synthesizer, and described the music with words. The arousal of the words they entered was highly correlated with the intended arousal of the music. The same was, surprisingly, not true for valence. The synthesizer is online, at [redacted URL].},
 address = {Birmingham, UK},
 author = {Krzyzaniak, Michael J},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.4813350},
 editor = {Romain Michon and Franziska Schroeder},
 issn = {2220-4806},
 month = {July},
 pages = {29--34},
 publisher = {Birmingham City University},
 title = {Words to Music Synthesis},
 url = {https://www.nime.org/proceedings/2020/nime2020_paper5.pdf},
 year = {2020}
}