Interactive Neural Resonators

Rodrigo Diaz, Charalampos Saitis, and Mark B Sandler

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2023
• Location: Mexico City, Mexico
• Track: Work in Progress
• Pages: 569–573
• Article Number: 81
• DOI: 10.5281/zenodo.11189296 (Link to paper)
• PDF link

Abstract:

In this work, we propose a method for the controllable synthesis of real-time contact sounds using neural resonators. Previous works have used physically inspired statistical methods and physical modelling for object materials and excitation signals. Our method incorporates differentiable second-order resonators and estimates their coefficients using a neural network that is conditioned on physical parameters. This allows for interactive dynamic control and the generation of novel sounds in an intuitive manner. We demonstrate the practical implementation of our method and explore its potential creative applications.

Citation:

BibTeX Entry:

  @inproceedings{nime2023_81,
 abstract = {In this work, we propose a method for the controllable synthesis of real-time contact sounds using neural resonators. Previous works have used physically inspired statistical methods and physical modelling for object materials and excitation signals. Our method incorporates differentiable second-order resonators and estimates their coefficients using a neural network that is conditioned on physical parameters. This allows for interactive dynamic control and the generation of novel sounds in an intuitive manner. We demonstrate the practical implementation of our method and explore its potential creative applications.},
 address = {Mexico City, Mexico},
 articleno = {81},
 author = {Rodrigo Diaz and Charalampos Saitis and Mark B Sandler},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.11189296},
 editor = {Miguel Ortiz and Adnan Marquez-Borbon},
 issn = {2220-4806},
 month = {May},
 numpages = {5},
 pages = {569--573},
 title = {Interactive Neural Resonators},
 track = {Work in Progress},
 url = {http://nime.org/proceedings/2023/nime2023_81.pdf},
 year = {2023}
}