Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing

Atau Tanaka, and Benjamin Knapp

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper describes a technique of multimodal, multichannel control of electronic musical devices using two control methodologies, the Electromyogram (EMG) and relative position sensing. Requirements for the application of multimodal interaction theory in the musical domain are discussed. We introduce the concept of bidirectional complementarity to characterize the relationship between the component sensing technologies. Each control can be used independently, but together they are mutually complementary. This reveals a fundamental difference from orthogonal systems. The creation of a concert piece based on this system is given as example.

Citation:

Atau Tanaka, and Benjamin Knapp. 2002. Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176464

BibTeX Entry:

  @inproceedings{Tanaka2002,
 abstract = {This paper describes a technique of multimodal, multichannel control of electronic musical devices using two control methodologies, the Electromyogram (EMG) and relative position sensing. Requirements for the application of multimodal interaction theory in the musical domain are discussed. We introduce the concept of bidirectional complementarity to characterize the relationship between the component sensing technologies. Each control can be used independently, but together they are mutually complementary. This reveals a fundamental difference from orthogonal systems. The creation of a concert piece based on this system is given as example. },
 address = {Dublin, Ireland},
 author = {Tanaka, Atau and Knapp, Benjamin},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 date = {24-26 May, 2002},
 doi = {10.5281/zenodo.1176464},
 issn = {2220-4806},
 keywords = {Human Computer Interaction, Musical Controllers, Electromyogram, Position Sensing, Sensor Instruments},
 pages = {171--176},
 title = {Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing},
 url = {http://www.nime.org/proceedings/2002/nime2002_171.pdf},
 year = {2002}
}