Supporting Interactive Machine Learning Approaches to Building Musical Instruments in the Browser

Louis McCallum, and Mick S Grierson

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Interactive machine learning (IML) is an approach to building interactive systems, including DMIs, focusing on iterative end-user data provision and direct evaluation. This paper describes the implementation of a Javascript library, encapsulating many of the boilerplate needs of building IML systems for creative tasks with minimal code inclusion and low barrier to entry. Further, we present a set of complimentary Audio Worklet-backed instruments to allow for in-browser creation of new musical systems able to run concurrently with various computationally expensive feature extractor and lightweight machine learning models without the interference often seen in interactive Web Audio applications.

Citation:

Louis McCallum, and Mick S Grierson. 2020. Supporting Interactive Machine Learning Approaches to Building Musical Instruments in the Browser. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.4813357

BibTeX Entry:

  @inproceedings{NIME20_51,
 abstract = {Interactive machine learning (IML) is an approach to building interactive systems, including DMIs, focusing on iterative end-user data provision and direct evaluation. This paper describes the implementation of a Javascript library, encapsulating many of the boilerplate needs of building IML systems for creative tasks with minimal code inclusion and low barrier to entry. Further, we present a set of complimentary Audio Worklet-backed instruments to allow for in-browser creation of new musical systems able to run concurrently with various computationally expensive feature extractor and lightweight machine learning models without the interference often seen in interactive Web Audio applications.},
 address = {Birmingham, UK},
 author = {McCallum, Louis and Grierson, Mick S},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.4813357},
 editor = {Romain Michon and Franziska Schroeder},
 issn = {2220-4806},
 month = {July},
 pages = {271--272},
 publisher = {Birmingham City University},
 title = {Supporting Interactive Machine Learning Approaches to Building Musical Instruments in the Browser},
 url = {https://www.nime.org/proceedings/2020/nime2020_paper51.pdf},
 year = {2020}
}