Using Music to Interact with a Virtual Character

Taylor, Robyn; Torres, Daniel; Boulanger, Pierre

Using Music to Interact with a Virtual Character

Robyn Taylor, Daniel Torres, and Pierre Boulanger

Proceedings of the International Conference on New Interfaces for Musical Expression

Year: 2005
Location: Vancouver, BC, Canada
Pages: 220–223
Keywords: Music, synthetic characters, advanced man-machine interfaces, virtual reality, behavioural systems, interaction techniques, visualization, immersive entertainment, artistic in- stallations
DOI: 10.5281/zenodo.1176826 (Link to paper)
PDF link

Abstract

We present a real-time system which allows musicians tointeract with synthetic virtual characters as they perform.Using Max/MSP to parameterize keyboard and vocal input, meaningful features (pitch, amplitude, chord information, and vocal timbre) are extracted from live performancein real-time. These extracted musical features are thenmapped to character behaviour in such a way that the musician's performance elicits a response from the virtual character. The system uses the ANIMUS framework to generatebelievable character expressions. Experimental results arepresented for simple characters.

Citation

Robyn Taylor, Daniel Torres, and Pierre Boulanger. 2005. Using Music to Interact with a Virtual Character. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176826

BibTeX Entry

@inproceedings{Taylor2005,
 abstract = {We present a real-time system which allows musicians tointeract with synthetic virtual characters as they perform.Using Max/MSP to parameterize keyboard and vocal input, meaningful features (pitch, amplitude, chord information, and vocal timbre) are extracted from live performancein real-time. These extracted musical features are thenmapped to character behaviour in such a way that the musician's performance elicits a response from the virtual character. The system uses the ANIMUS framework to generatebelievable character expressions. Experimental results arepresented for simple characters.},
 address = {Vancouver, BC, Canada},
 author = {Taylor, Robyn and Torres, Daniel and Boulanger, Pierre},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176826},
 issn = {2220-4806},
 keywords = {Music, synthetic characters, advanced man-machine interfaces, virtual reality, behavioural systems, interaction techniques, visualization, immersive entertainment, artistic in- stallations },
 pages = {220--223},
 title = {Using Music to Interact with a Virtual Character},
 url = {http://www.nime.org/proceedings/2005/nime2005_220.pdf},
 year = {2005}
}