States and Sound: Modelling Interactions with Musical User Interfaces

Jeppe Veirum Larsen, and Hendrik Knoche

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Musical instruments and musical user interfaces provide rich input and feedback through mostly tangible interactions, resulting in complex behavior. However, publications of novel interfaces often lack the required detail due to the complexity or the focus on a specific part of the interfaces and absence of a specific template or structure to describe these interactions. Drawing on and synthesizing models from interaction design and music making we propose a way for modeling musical interfaces by providing a scheme and visual language to describe, design, analyze, and compare interfaces for music making. To illustrate its capabilities we apply the proposed model to a range of assistive musical instruments, which often draw on multi-modal in- and output, resulting in complex designs and descriptions thereof.

Citation:

Jeppe Veirum Larsen, and Hendrik Knoche. 2017. States and Sound: Modelling Interactions with Musical User Interfaces. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176187

BibTeX Entry:

  @inproceedings{jlarsen2017,
 abstract = {Musical instruments and musical user interfaces provide rich input and feedback through mostly tangible interactions, resulting in complex behavior.  However, publications of novel interfaces often lack the required detail due to the complexity or the focus on a specific part of the interfaces and absence of a specific template or structure to describe these interactions. Drawing on and synthesizing models from interaction design and music making we propose a way for modeling musical interfaces by providing a scheme and visual language to describe, design, analyze, and compare interfaces for music making. To illustrate its capabilities we apply the proposed model to a range of assistive musical instruments, which often draw on multi-modal in- and output, resulting in complex designs and descriptions thereof.},
 address = {Copenhagen, Denmark},
 author = {Jeppe Veirum Larsen and Hendrik Knoche},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176187},
 issn = {2220-4806},
 pages = {104--109},
 publisher = {Aalborg University Copenhagen},
 title = {States and Sound: Modelling Interactions with Musical User Interfaces},
 url = {http://www.nime.org/proceedings/2017/nime2017_paper0021.pdf},
 year = {2017}
}