A polyphonic pitch tracking embedded system for rapid instrument augmentation

Rodrigo Schramm, Federico Visi, André Brasil, and Marcelo O Johann

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper presents a system for easily augmenting polyphonic pitched instruments. The entire system is designed to run on a low-cost embedded computer, suitable for live performance and easy to customise for different use cases. The core of the system implements real-time spectrum factorisation, decomposing polyphonic audio input signals into music note activations. New instruments can be easily added to the system with the help of custom spectral template dictionaries. Instrument augmentation is achieved by replacing or mixing the instrument's original sounds with a large variety of synthetic or sampled sounds, which follow the polyphonic pitch activations.

Citation:

Rodrigo Schramm, Federico Visi, André Brasil, and Marcelo O Johann. 2018. A polyphonic pitch tracking embedded system for rapid instrument augmentation. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1302650

BibTeX Entry:

  @inproceedings{Schramm2018,
 abstract = {This paper presents a system for easily augmenting polyphonic pitched instruments. The entire system is designed to run on a low-cost embedded computer, suitable for live performance and easy to customise for different use cases. The core of the system implements real-time spectrum factorisation, decomposing polyphonic audio input signals into music note activations. New instruments can be easily added to the system with the help of custom spectral template dictionaries. Instrument augmentation is achieved by replacing or mixing the instrument's original sounds with a large variety of synthetic or sampled sounds, which follow the polyphonic pitch activations.},
 address = {Blacksburg, Virginia, USA},
 author = {Rodrigo Schramm and Federico Visi and André Brasil and Marcelo O Johann},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1302650},
 editor = {Luke Dahl, Douglas Bowman, Thomas Martin},
 isbn = {978-1-949373-99-8},
 issn = {2220-4806},
 month = {June},
 pages = {120--125},
 publisher = {Virginia Tech},
 title = {A polyphonic pitch tracking embedded system for rapid instrument augmentation},
 url = {http://www.nime.org/proceedings/2018/nime2018_paper0027.pdf},
 year = {2018}
}