Supporting Interactive Machine Learning Approaches to Building Musical Instruments in the Browser
Louis McCallum, and Mick S Grierson
Proceedings of the International Conference on New Interfaces for Musical Expression
- Year: 2020
- Location: Birmingham, UK
- Pages: 271–272
- DOI: 10.5281/zenodo.4813357 (Link to paper)
- PDF link
Abstract:
Interactive machine learning (IML) is an approach to building interactive systems, including DMIs, focusing on iterative end-user data provision and direct evaluation. This paper describes the implementation of a Javascript library, encapsulating many of the boilerplate needs of building IML systems for creative tasks with minimal code inclusion and low barrier to entry. Further, we present a set of complimentary Audio Worklet-backed instruments to allow for in-browser creation of new musical systems able to run concurrently with various computationally expensive feature extractor and lightweight machine learning models without the interference often seen in interactive Web Audio applications.
Citation:
Louis McCallum, and Mick S Grierson. 2020. Supporting Interactive Machine Learning Approaches to Building Musical Instruments in the Browser. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.4813357BibTeX Entry:
@inproceedings{NIME20_51, abstract = {Interactive machine learning (IML) is an approach to building interactive systems, including DMIs, focusing on iterative end-user data provision and direct evaluation. This paper describes the implementation of a Javascript library, encapsulating many of the boilerplate needs of building IML systems for creative tasks with minimal code inclusion and low barrier to entry. Further, we present a set of complimentary Audio Worklet-backed instruments to allow for in-browser creation of new musical systems able to run concurrently with various computationally expensive feature extractor and lightweight machine learning models without the interference often seen in interactive Web Audio applications.}, address = {Birmingham, UK}, author = {McCallum, Louis and Grierson, Mick S}, booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression}, doi = {10.5281/zenodo.4813357}, editor = {Romain Michon and Franziska Schroeder}, issn = {2220-4806}, month = {July}, pages = {271--272}, publisher = {Birmingham City University}, title = {Supporting Interactive Machine Learning Approaches to Building Musical Instruments in the Browser}, url = {https://www.nime.org/proceedings/2020/nime2020_paper51.pdf}, year = {2020} }