Interactive Neural Resonators

Rodrigo Diaz, Charalampos Saitis, and Mark B Sandler

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this work, we propose a method for the controllable synthesis of real-time contact sounds using neural resonators. Previous works have used physically inspired statistical methods and physical modelling for object materials and excitation signals. Our method incorporates differentiable second-order resonators and estimates their coefficients using a neural network that is conditioned on physical parameters. This allows for interactive dynamic control and the generation of novel sounds in an intuitive manner. We demonstrate the practical implementation of our method and explore its potential creative applications.

Citation:

Rodrigo Diaz, Charalampos Saitis, and Mark B Sandler. 2023. Interactive Neural Resonators. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.11189296

BibTeX Entry:

  @inproceedings{nime2023_81,
 abstract = {In this work, we propose a method for the controllable synthesis of real-time contact sounds using neural resonators. Previous works have used physically inspired statistical methods and physical modelling for object materials and excitation signals. Our method incorporates differentiable second-order resonators and estimates their coefficients using a neural network that is conditioned on physical parameters. This allows for interactive dynamic control and the generation of novel sounds in an intuitive manner. We demonstrate the practical implementation of our method and explore its potential creative applications.},
 address = {Mexico City, Mexico},
 articleno = {81},
 author = {Rodrigo Diaz and Charalampos Saitis and Mark B Sandler},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.11189296},
 editor = {Miguel Ortiz and Adnan Marquez-Borbon},
 issn = {2220-4806},
 month = {May},
 numpages = {5},
 pages = {569--573},
 title = {Interactive Neural Resonators},
 track = {Work in Progress},
 url = {http://nime.org/proceedings/2023/nime2023_81.pdf},
 year = {2023}
}