COSMIC: A Conversational Interface for Human-AI Music Co-Creation

Yixiao Zhang, Gus Xia, Mark Levy, and Simon Dixon

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

In this paper, we propose COSMIC, a COnverSational Interface for Human-AI MusIc Co-Creation. It is a chatbot with a two-fold design philosophy: to understand human creative intent and to help humans in their creation. The core Natural Language Processing (NLP) module is responsible for three functions: 1) understanding human needs in chat, 2) cross-modal interaction between natural language understanding and music generation models, and 3) mixing and coordinating multiple algorithms to complete the composition.1

Citation

Yixiao Zhang, Gus Xia, Mark Levy, and Simon Dixon. 2021. COSMIC: A Conversational Interface for Human-AI Music Co-Creation. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.21428/92fbeb44.110a7a32

BibTeX Entry

@inproceedings{NIME21_41,
 abstract = {In this paper, we propose COSMIC, a COnverSational Interface for Human-AI MusIc Co-Creation. It is a chatbot with a two-fold design philosophy: to understand human creative intent and to help humans in their creation. The core Natural Language Processing (NLP) module is responsible for three functions: 1) understanding human needs in chat, 2) cross-modal interaction between natural language understanding and music generation models, and 3) mixing and coordinating multiple algorithms to complete the composition.1},
 address = {Shanghai, China},
 articleno = {41},
 author = {Zhang, Yixiao and Xia, Gus and Levy, Mark and Dixon, Simon},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.110a7a32},
 issn = {2220-4806},
 month = {June},
 presentation-video = {https://youtu.be/o5YO0ni7sng},
 title = {COSMIC: A Conversational Interface for Human-AI Music Co-Creation},
 url = {https://nime.pubpub.org/pub/in6wsc9t},
 year = {2021}
}