Representation-Plurality in Multi-Touch Mobile Visual Programming for Music

Qi Yang, and Georg Essl

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

Multi-touch mobile devices provide a fresh paradigm for interactions, as well as a platform for building rich musical applications. This paper presents a multi-touch mobile programming environment that supports the exploration of different representations in visual programming for music and audio interfaces. Using a common flow-based visual programming vocabulary, we implemented a system based on the urMus platform that explores three types of touch-based interaction representations: a text-based menu representation, a graphical icon-based representation, and a novel multi-touch gesture-based representation. We illustrated their use on interface design for musical controllers.

Citation

Qi Yang, and Georg Essl. 2015. Representation-Plurality in Multi-Touch Mobile Visual Programming for Music. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1181416

BibTeX Entry

@inproceedings{qyang2015,
 abstract = {Multi-touch mobile devices provide a fresh paradigm for interactions, as well as a platform for building rich musical applications. This paper presents a multi-touch mobile programming environment that supports the exploration of different representations in visual programming for music and audio interfaces. Using a common flow-based visual programming vocabulary, we implemented a system based on the urMus platform that explores three types of touch-based interaction representations: a text-based menu representation, a graphical icon-based representation, and a novel multi-touch gesture-based representation. We illustrated their use on interface design for musical controllers.},
 address = {Baton Rouge, Louisiana, USA},
 author = {Qi Yang and Georg Essl},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1181416},
 editor = {Edgar Berdahl and Jesse Allison},
 issn = {2220-4806},
 month = {May},
 pages = {369--373},
 publisher = {Louisiana State University},
 title = {Representation-Plurality in Multi-Touch Mobile Visual Programming for Music},
 url = {http://www.nime.org/proceedings/2015/nime2015_177.pdf},
 year = {2015}
}