A Survey on the Use of 2D Touch Interfaces for Musical Expression

Diemo Schwarz, Abby Wanyu Liu, and Frederic Bevilacqua

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Expressive 2D multi-touch interfaces have in recent years moved from research prototypes to industrial products, from repurposed generic computer input devices to controllers specially designed for musical expression. A host of practicioners use this type of devices in many different ways, with different gestures and sound synthesis or transformation methods. In order to get an overview of existing and desired usages, we launched an on-line survey that collected 37 answers from practicioners in and outside of academic and design communities. In the survey we inquired about the participants' devices, their strengths and weaknesses, the layout of control dimensions, the used gestures and mappings, the synthesis software or hardware and the use of audio descriptors and machine learning. The results can inform the design of future interfaces, gesture analysis and mapping, and give directions for the need and use of machine learning for user adaptation.

Citation:

Diemo Schwarz, Abby Wanyu Liu, and Frederic Bevilacqua. 2020. A Survey on the Use of 2D Touch Interfaces for Musical Expression. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.4813318

BibTeX Entry:

  @inproceedings{NIME20_38,
 abstract = {Expressive 2D multi-touch interfaces have in recent years moved from research prototypes to industrial products, from repurposed generic computer input devices to controllers specially designed for musical expression. A host of practicioners use this type of devices in many different ways, with different gestures and sound synthesis or transformation methods. In order to get an overview of existing and desired usages, we launched an on-line survey that collected 37 answers from practicioners in and outside of academic and design communities. In the survey we inquired about the participants' devices, their strengths and weaknesses, the layout of control dimensions, the used gestures and mappings, the synthesis software or hardware and the use of audio descriptors and machine learning. The results can inform the design of future interfaces, gesture analysis and mapping, and give directions for the need and use of machine learning for user adaptation.},
 address = {Birmingham, UK},
 author = {Schwarz, Diemo and Liu, Abby Wanyu and Bevilacqua, Frederic},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.4813318},
 editor = {Romain Michon and Franziska Schroeder},
 issn = {2220-4806},
 month = {July},
 pages = {196--201},
 presentation-video = {https://youtu.be/eE8I3mecaB8},
 publisher = {Birmingham City University},
 title = {A Survey on the Use of 2D Touch Interfaces for Musical Expression},
 url = {https://www.nime.org/proceedings/2020/nime2020_paper38.pdf},
 year = {2020}
}