A Customizable Sensate Surface for Music Control

Nan-Wei Gong, Nan Zhao, and Joseph Paradiso

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper describes a novel music control sensate surface, which enables integration between any musical instruments with a v ersatile, customizable, and essentially cost-effective user interface. This sensate surface is based on c onductive inkjet printing technology which allows capacitive sensor electrodes and connections between electronics components to be printed onto a large roll of flexible substrate that is unrestricted in length. The high dynamic range capacitive sensing electrodes can not only infer touch, but near-range, non-contact gestural nuance in a music performance. With this sensate surface, users can ``cut'' out their desired shapes, ``paste'' the number of inputs, and customize their controller interface, which can then send signals wirelessly to effects or software synthesizers. We seek to find a solution for integrating the form factor of traditional music controllers seamlessly on top of one's music instrument and meanwhile adding expressiveness to the music performance by sensing and incorporating movements and gestures to manipulate the musical output. We present an example of implementation on an electric ukulele and provide several design examples to demonstrate the versatile capabilities of this system.

Citation:

Nan-Wei Gong, Nan Zhao, and Joseph Paradiso. 2012. A Customizable Sensate Surface for Music Control. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178267

BibTeX Entry:

  @inproceedings{Gong2012,
 abstract = {This paper describes a novel music control sensate surface, which enables integration between any musical instruments with a v ersatile, customizable, and essentially cost-effective user interface. This sensate surface is based on c onductive inkjet printing technology which allows capacitive sensor electrodes and connections between electronics components to be printed onto a large roll of flexible substrate that is unrestricted in length. The high dynamic range capacitive sensing electrodes can not only infer touch, but near-range, non-contact gestural nuance in a music performance. With this sensate surface, users can ``cut'' out their desired shapes, ``paste'' the number of inputs, and customize their controller interface, which can then send signals wirelessly to effects or software synthesizers. We seek to find a solution for integrating the form factor of traditional music controllers seamlessly on top of one's music instrument and meanwhile adding expressiveness to the music performance by sensing and incorporating movements and gestures to manipulate the musical output. We present an example of implementation on an electric ukulele and provide several design examples to demonstrate the versatile capabilities of this system.},
 address = {Ann Arbor, Michigan},
 author = {Nan-Wei Gong and Nan Zhao and Joseph Paradiso},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178267},
 issn = {2220-4806},
 keywords = {Sensate surface, music controller skin, customizable controller surface, flexible electronics},
 publisher = {University of Michigan},
 title = {A Customizable Sensate Surface for Music Control},
 url = {http://www.nime.org/proceedings/2012/nime2012_201.pdf},
 year = {2012}
}