Tapping Into a New Paradigm: A Synthetic Strategy for Automatic Drum TapScription

André Santos, Amílcar Cardoso, Matthew E. P. Davies, and Roger B. Dannenberg

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

We introduce Automatic Drum TapScription (ADTS), a novel paradigm for rhythmic interaction consisting of transcribing arbitrarily-timbred taps into drum representations. Our approach targets taps produced on a variety of surfaces without other controlled timbral characteristics other than playing style. Our long-term goal is to enable more accessible and creative percussive exploration, but presents significant challenges due to the minimal timbre variation between taps intended to represent different drum classes. To address these challenges, we take the first steps toward achieving ADTS by designing an effective dataset synthesis strategy. This strategy enables new opportuneties for musical expression by considering drumming at a more semantic or functional level as opposed to a simple collection of timbres. We present initial results, comparing three different models: one trained on drum data, another trained on a small dataset of quasi-aligned tapped performances, and another trained on our synthetic dataset. Our synthetic approach shows promise, demonstrating progress in this untapped domain.

Citation

André Santos, Amílcar Cardoso, Matthew E. P. Davies, and Roger B. Dannenberg. 2025. Tapping Into a New Paradigm: A Synthetic Strategy for Automatic Drum TapScription. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.15698956 [PDF]

BibTeX Entry

@article{nime2025_80,
 abstract = {We introduce Automatic Drum TapScription (ADTS), a novel paradigm for rhythmic interaction consisting of transcribing arbitrarily-timbred taps into drum representations. Our approach targets taps produced on a variety of surfaces without other controlled timbral characteristics other than playing style. Our long-term goal is to enable more accessible and creative percussive exploration, but presents significant challenges due to the minimal timbre variation between taps intended to represent different drum classes. To address these challenges, we take the first steps toward achieving ADTS by designing an effective dataset synthesis strategy. This strategy enables new opportuneties for musical expression by considering drumming at a more semantic or functional level as opposed to a simple collection of timbres. We present initial results, comparing three different models: one trained on drum data, another trained on a small dataset of quasi-aligned tapped performances, and another trained on our synthetic dataset. Our synthetic approach shows promise, demonstrating progress in this untapped domain.},
 address = {Canberra, Australia},
 articleno = {80},
 author = {André Santos and Amílcar Cardoso and Matthew  E. P. Davies and Roger B. Dannenberg},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.15698956},
 editor = {Doga Cavdir and Florent Berthaut},
 issn = {2220-4806},
 month = {June},
 numpages = {7},
 pages = {549--555},
 title = {Tapping Into a New Paradigm: A Synthetic Strategy for Automatic Drum TapScription},
 track = {Paper},
 url = {http://nime.org/proceedings/2025/nime2025_80.pdf},
 year = {2025}
}