You're The Conductor: A Realistic Interactive Conducting System for Children

Eric Lee, Teresa M. Nakra, and Jan Borchers

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper describes the first system designed to allow children to conduct an audio and video recording of an orchestra. No prior music experience is required to control the orchestra, and the system uses an advanced algorithm to time stretch the audio in real-time at high quality and without altering the pitch. We will discuss the requirements and challenges of designing an interface to target our particular user group (children), followed by some system implementation details. An overview of the algorithm used for audio time stretching will also be presented. We are currently using this technology to study and compare professional and non-professional conducting behavior, and its implications when designing new interfaces for multimedia. You're the Conductor is currently a successful exhibit at the Children's Museum in Boston, USA.

Citation:

Eric Lee, Teresa M. Nakra, and Jan Borchers. 2004. You're The Conductor: A Realistic Interactive Conducting System for Children. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176629

BibTeX Entry:

  @inproceedings{Lee2004,
 abstract = {This paper describes the first system designed to allow children to conduct an audio and video recording of an orchestra. No prior music experience is required to control the orchestra, and the system uses an advanced algorithm to time stretch the audio in real-time at high quality and without altering the pitch. We will discuss the requirements and challenges of designing an interface to target our particular user group (children), followed by some system implementation details. An overview of the algorithm used for audio time stretching will also be presented. We are currently using this technology to study and compare professional and non-professional conducting behavior, and its implications when designing new interfaces for multimedia. You're the Conductor is currently a successful exhibit at the Children's Museum in Boston, USA.},
 address = {Hamamatsu, Japan},
 author = {Lee, Eric and Nakra, Teresa M. and Borchers, Jan},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176629},
 issn = {2220-4806},
 keywords = {conducting systems,design patterns,gesture recogni-,interactive exhibits,real-time audio stretching,tion},
 pages = {68--73},
 title = {You're The Conductor: A Realistic Interactive Conducting System for Children},
 url = {http://www.nime.org/proceedings/2004/nime2004_068.pdf},
 year = {2004}
}