GeKiPe, a gesture-based interface for audiovisual performance

José Miguel Fernandez, Thomas Köppel, Nina Verstraete, Grégoire Lorieux, Alexander Vert, and Philippe Spiesser

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2017
• Location: Copenhagen, Denmark
• Pages: 450–455
• DOI: 10.5281/zenodo.1176312 (Link to paper)
• PDF link

Abstract:

We present here GeKiPe, a gestural interface for musical expression, combining images and sounds, generated and controlled in real time by a performer. GeKiPe is developed as part of a creation project, exploring the control of virtual instruments through the analysis of gestures specific to instrumentalists, and to percussionists in particular. GeKiPe was used for the creation of a collaborative stage performance (Sculpt), in which the musician and their movements are captured by different methods (infrared Kinect cameras and gesture-sensors on controller gloves). The use of GeKiPe as an alternate sound and image controller allowed us to combine body movement, musical gestures and audiovisual expressions to create challenging collaborative performances.

Citation:

BibTeX Entry:

  @inproceedings{jfernandez2017,
 abstract = {We present here GeKiPe, a gestural interface for musical expression, combining images and sounds, generated and controlled in real time by a performer. GeKiPe is developed as part of a creation project, exploring the control of virtual instruments through the analysis of gestures specific to instrumentalists, and to percussionists in particular. GeKiPe was used for the creation of a collaborative stage performance (Sculpt), in which the musician and their movements are captured by different methods (infrared Kinect cameras and gesture-sensors on controller gloves). The use of GeKiPe as an alternate sound and image controller allowed us to combine body movement, musical gestures and audiovisual expressions to create challenging collaborative performances.},
 address = {Copenhagen, Denmark},
 author = {José Miguel Fernandez and Thomas Köppel and Nina Verstraete and Grégoire Lorieux and Alexander Vert and Philippe Spiesser},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176312},
 issn = {2220-4806},
 pages = {450--455},
 publisher = {Aalborg University Copenhagen},
 title = {GeKiPe, a gesture-based interface for audiovisual performance},
 url = {http://www.nime.org/proceedings/2017/nime2017_paper0085.pdf},
 year = {2017}
}