Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions

Golan Levin, and Zachary Lieberman

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2005
• Location: Vancouver, BC, Canada
• Pages: 115–120
• Keywords: Audiovisual performance, hand silhouettes, computer vision, contour analysis, sound-image relationships, augmented reality.
• DOI: 10.5281/zenodo.1176772 (Link to paper)
• PDF link

Abstract:

We report on The Manual Input Sessions, a series of audiovisual vignettes which probe the expressive possibilities of free-form hand gestures. Performed on a hybrid projection system which combines a traditional analog overhead projector and a digital PC video projector, our vision-based software instruments generate dynamic sounds and graphics solely in response to the forms and movements of the silhouette contours of the user's hands. Interactions and audiovisual mappings which make use of both positive (exterior) and negative (interior) contours are discussed.

Citation:

BibTeX Entry:

  @inproceedings{Levin2005a,
 abstract = {We report on The Manual Input Sessions, a series of audiovisual vignettes which probe the expressive possibilities of free-form hand gestures. Performed on a hybrid projection system which combines a traditional analog overhead projector and a digital PC video projector, our vision-based software instruments generate dynamic sounds and graphics solely in response to the forms and movements of the silhouette contours of the user's hands. Interactions and audiovisual mappings which make use of both positive (exterior) and negative (interior) contours are discussed. },
 address = {Vancouver, BC, Canada},
 author = {Levin, Golan and Lieberman, Zachary},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176772},
 issn = {2220-4806},
 keywords = {Audiovisual performance, hand silhouettes, computer vision, contour analysis, sound-image relationships, augmented reality. },
 pages = {115--120},
 title = {Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions},
 url = {http://www.nime.org/proceedings/2005/nime2005_115.pdf},
 year = {2005}
}