Using Music to Interact with a Virtual Character

Robyn Taylor, Daniel Torres, and Pierre Boulanger

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2005
• Location: Vancouver, BC, Canada
• Pages: 220–223
• Keywords: Music, synthetic characters, advanced man-machine interfaces, virtual reality, behavioural systems, interaction techniques, visualization, immersive entertainment, artistic in- stallations
• DOI: 10.5281/zenodo.1176826 (Link to paper)
• PDF link

Abstract:

We present a real-time system which allows musicians tointeract with synthetic virtual characters as they perform.Using Max/MSP to parameterize keyboard and vocal input, meaningful features (pitch, amplitude, chord information, and vocal timbre) are extracted from live performancein real-time. These extracted musical features are thenmapped to character behaviour in such a way that the musician's performance elicits a response from the virtual character. The system uses the ANIMUS framework to generatebelievable character expressions. Experimental results arepresented for simple characters.

Citation:

BibTeX Entry:

  @inproceedings{Taylor2005,
 abstract = {We present a real-time system which allows musicians tointeract with synthetic virtual characters as they perform.Using Max/MSP to parameterize keyboard and vocal input, meaningful features (pitch, amplitude, chord information, and vocal timbre) are extracted from live performancein real-time. These extracted musical features are thenmapped to character behaviour in such a way that the musician's performance elicits a response from the virtual character. The system uses the ANIMUS framework to generatebelievable character expressions. Experimental results arepresented for simple characters.},
 address = {Vancouver, BC, Canada},
 author = {Taylor, Robyn and Torres, Daniel and Boulanger, Pierre},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176826},
 issn = {2220-4806},
 keywords = {Music, synthetic characters, advanced man-machine interfaces, virtual reality, behavioural systems, interaction techniques, visualization, immersive entertainment, artistic in- stallations },
 pages = {220--223},
 title = {Using Music to Interact with a Virtual Character},
 url = {http://www.nime.org/proceedings/2005/nime2005_220.pdf},
 year = {2005}
}