Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases

Anna Xambó, Gerard Roma, Alexander Lerch, Mathieu Barthet, and György Fazekas

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The recent increase in the accessibility and size of personal and crowdsourced digital sound collections brought about a valuable resource for music creation. Finding and retrieving relevant sounds in performance leads to challenges that can be approached using music information retrieval (MIR). In this paper, we explore the use of MIR to retrieve and repurpose sounds in musical live coding. We present a live coding system built on SuperCollider enabling the use of audio content from online Creative Commons (CC) sound databases such as Freesound or personal sound databases. The novelty of our approach lies in exploiting high-level MIR methods (e.g., query by pitch or rhythmic cues) using live coding techniques applied to sounds. We demonstrate its potential through the reflection of an illustrative case study and the feedback from four expert users. The users tried the system with either a personal database or a crowdsourced database and reported its potential in facilitating tailorability of the tool to their own creative workflows.

Citation:

Anna Xambó, Gerard Roma, Alexander Lerch, Mathieu Barthet, and György Fazekas. 2018. Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1302625

BibTeX Entry:

  @inproceedings{Xambób2018,
 abstract = {The recent increase in the accessibility and size of personal and crowdsourced digital sound collections brought about a valuable resource for music creation. Finding and retrieving relevant sounds in performance leads to challenges that can be approached using music information retrieval (MIR). In this paper, we explore the use of MIR to retrieve and repurpose sounds in musical live coding. We present a live coding system built on SuperCollider enabling the use of audio content from online Creative Commons (CC) sound databases such as Freesound or personal sound databases. The novelty of our approach lies in exploiting high-level MIR methods (e.g., query by pitch or rhythmic cues) using live coding techniques applied to sounds. We demonstrate its potential through the reflection of an illustrative case study and the feedback from four expert users. The users tried the system with either a personal database or a crowdsourced database and reported its potential in facilitating tailorability of the tool to their own creative workflows.},
 address = {Blacksburg, Virginia, USA},
 author = {Anna Xambó and Gerard Roma and Alexander Lerch and Mathieu Barthet and György Fazekas},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1302625},
 editor = {Luke Dahl, Douglas Bowman, Thomas Martin},
 isbn = {978-1-949373-99-8},
 issn = {2220-4806},
 month = {June},
 pages = {364--369},
 publisher = {Virginia Tech},
 title = {Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases},
 url = {http://www.nime.org/proceedings/2018/nime2018_paper0081.pdf},
 year = {2018}
}