Performance with Esteso: Interactive AI Music Duet Based on Player-Idiosyncratic Extended Double Bass Techniques

Filiippo Angeloni, Domenico Stefani, and Matteo Tomasetti

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Esteso is an interactive improvisational system for double-bass based on player-idiosyncratic extended techniques. It was created in collaboration with the contemporary double-bass player and composer Filippo Angeloni and tailored for his personal vocabulary of extended techniques. In Esteso, the musician and an AI counterpart take turns in an improvisational duet. The system's response consists of a manipulation of the real double-bass, achieved live through a timbre-transfer neural network, granular synthesis, and reverberation. The timbre-transfer network was trained on generic double-bass recordings, resulting in a peculiar ‘hybrid’ double-bass sound. We Machine listening is integrated in the form of a real-time classifier of extended techniques played on the double-bass, whose output controls the sound manipulation process to affect various techniques differently. The personal extended techniques chosen for Esteso are: ‘Brushed’ Jeté, Sfregato con legno, and Percussive. Here, we propose a 10/15 minutes improvised duet performance where the double bass player interacts with Esteso, creating an action-reaction interplay between acoustic and virtual.

Citation

Filiippo Angeloni, Domenico Stefani, and Matteo Tomasetti. 2024. Performance with Esteso: Interactive AI Music Duet Based on Player-Idiosyncratic Extended Double Bass Techniques. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.15028089

BibTeX Entry

@article{nime2024_music_35,
 abstract = {Esteso is an interactive improvisational system for double-bass based on player-idiosyncratic extended techniques. It was created in collaboration with the contemporary double-bass player and composer Filippo Angeloni and tailored for his personal vocabulary of extended techniques. In Esteso, the musician and an AI counterpart take turns in an improvisational duet. The system's response consists of a manipulation of the real double-bass, achieved live through a timbre-transfer neural network, granular synthesis, and reverberation. The timbre-transfer network was trained on generic double-bass recordings, resulting in a peculiar ‘hybrid’ double-bass sound. We Machine listening is integrated in the form of a real-time classifier of extended techniques played on the double-bass, whose output controls the sound manipulation process to affect various techniques differently. The personal extended techniques chosen for Esteso are: ‘Brushed’ Jeté, Sfregato con legno, and Percussive. Here, we propose a 10/15 minutes improvised duet performance where the double bass player interacts with Esteso, creating an action-reaction interplay between acoustic and virtual.},
 address = {Utrecht, Netherlands},
 articleno = {35},
 author = {Filiippo Angeloni and Domenico Stefani and Matteo Tomasetti},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.15028089},
 editor = {Laurel Smith Pardue and Palle Dahlstedt},
 issn = {2220-4806},
 month = {September},
 numpages = {4},
 pages = {122--125},
 presentation-video = {https://youtu.be/oncw3G4sLuM},
 title = {Performance with Esteso: Interactive AI Music Duet Based on Player-Idiosyncratic Extended Double Bass Techniques},
 track = {Music},
 url = {http://nime.org/proceedings/2024/nime2024_music_35.pdf},
 year = {2024}
}