Visual Feedback in Performer-Machine Interaction for Musical Improvisation

Alexandre R. François, Elaine Chew, and Dennis Thurmond

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper describes the design of Mimi, a multi-modal interactive musical improvisation system that explores the potential and powerful impact of visual feedback in performermachine interaction. Mimi is a performer-centric tool designed for use in performance and teaching. Its key andnovel component is its visual interface, designed to providethe performer with instantaneous and continuous information on the state of the system. For human improvisation,in which context and planning are paramount, the relevantstate of the system extends to the near future and recentpast. Mimi's visual interface allows for a peculiar blendof raw reflex typically associated with improvisation, andpreparation and timing more closely affiliated with scorebased reading. Mimi is not only an effective improvisationpartner, it has also proven itself to be an invaluable platformthrough which to interrogate the mental models necessaryfor successful improvisation.

Citation:

Alexandre R. François, Elaine Chew, and Dennis Thurmond. 2007. Visual Feedback in Performer-Machine Interaction for Musical Improvisation. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177091

BibTeX Entry:

  @inproceedings{Francois2007,
 abstract = {This paper describes the design of Mimi, a multi-modal interactive musical improvisation system that explores the potential and powerful impact of visual feedback in performermachine interaction. Mimi is a performer-centric tool designed for use in performance and teaching. Its key andnovel component is its visual interface, designed to providethe performer with instantaneous and continuous information on the state of the system. For human improvisation,in which context and planning are paramount, the relevantstate of the system extends to the near future and recentpast. Mimi's visual interface allows for a peculiar blendof raw reflex typically associated with improvisation, andpreparation and timing more closely affiliated with scorebased reading. Mimi is not only an effective improvisationpartner, it has also proven itself to be an invaluable platformthrough which to interrogate the mental models necessaryfor successful improvisation.},
 address = {New York City, NY, United States},
 author = {Fran\c{c}ois, Alexandre R. and Chew, Elaine and Thurmond, Dennis},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177091},
 issn = {2220-4806},
 keywords = {Performer-machine interaction, visualization design, machine improvisation },
 pages = {277--280},
 title = {Visual Feedback in Performer-Machine Interaction for Musical Improvisation},
 url = {http://www.nime.org/proceedings/2007/nime2007_277.pdf},
 year = {2007}
}