Design Issues in Interaction Modeling for Free Improvisation

William Hsu

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In previous publications (see for example [2] and [3]), we described an interactive music system, designed to improvise with saxophonist John Butcher; our system analyzes timbral and gestural features in real-time, and uses this information to guide response generation. This paper overviews our recent work with the system's interaction management component (IMC). We explore several options for characterizing improvisation at a higher level, and managing decisions for interactive performance in a rich timbral environment. We developed a simple, efficient framework using a small number of features suggested by recent work in mood modeling in music. We describe and evaluate the first version of the IMC, which was used in performance at the Live Algorithms for Music (LAM) conference in December 2006. We touch on developments on the system since LAM, and discuss future plans to address perceived shortcomings in responsiveness, and the ability of the system to make long-term adaptations.

Citation:

William Hsu. 2007. Design Issues in Interaction Modeling for Free Improvisation. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177123

BibTeX Entry:

  @inproceedings{Hsu2007,
 abstract = {In previous publications (see for example [2] and [3]), we described an interactive music system, designed to improvise with saxophonist John Butcher; our system analyzes timbral and gestural features in real-time, and uses this information to guide response generation. This paper overviews our recent work with the system's interaction management component (IMC). We explore several options for characterizing improvisation at a higher level, and managing decisions for interactive performance in a rich timbral environment. We developed a simple, efficient framework using a small number of features suggested by recent work in mood modeling in music. We describe and evaluate the first version of the IMC, which was used in performance at the Live Algorithms for Music (LAM) conference in December 2006. We touch on developments on the system since LAM, and discuss future plans to address perceived shortcomings in responsiveness, and the ability of the system to make long-term adaptations. },
 address = {New York City, NY, United States},
 author = {Hsu, William},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177123},
 issn = {2220-4806},
 keywords = {Interactive music systems, timbral analysis, free improvisation. },
 pages = {367--370},
 title = {Design Issues in Interaction Modeling for Free Improvisation},
 url = {http://www.nime.org/proceedings/2007/nime2007_367.pdf},
 year = {2007}
}