Real-time Gesture Mapping in Pd Environment using Neural Networks

Arshia Cont, Thierry Coduys, and Cyrille Henry

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2004
• Location: Hamamatsu, Japan
• Pages: 39–42
• Keywords: Real-time gesture control, adaptive interfaces, Sensor and actuator technologies for musical applications, Musical mapping algorithms and intelligent controllers, Pure Data.
• DOI: 10.5281/zenodo.1176589 (Link to paper)
• PDF link

Abstract:

In this paper, we describe an adaptive approach to gesture mapping for musical applications which serves as a mapping system for music instrument design. A neural network approach is chosen for this goal and all the required interfaces and abstractions are developed and demonstrated in the Pure Data environment. In this paper, we will focus on neural network representation and implementation in a real-time musical environment. This adaptive mapping is evaluated in different static and dynamic situations by a network of sensors sampled at a rate of 200Hz in real-time. Finally, some remarks are given on the network design and future works.

Citation:

BibTeX Entry:

  @inproceedings{Cont2004,
 abstract = {In this paper, we describe an adaptive approach to gesture mapping for musical applications which serves as a mapping system for music instrument design. A neural network approach is chosen for this goal and all the required interfaces and abstractions are developed and demonstrated in the Pure Data environment. In this paper, we will focus on neural network representation and implementation in a real-time musical environment. This adaptive mapping is evaluated in different static and dynamic situations by a network of sensors sampled at a rate of 200Hz in real-time. Finally, some remarks are given on the network design and future works. },
 address = {Hamamatsu, Japan},
 author = {Cont, Arshia and Coduys, Thierry and Henry, Cyrille},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176589},
 issn = {2220-4806},
 keywords = {Real-time gesture control, adaptive interfaces, Sensor and actuator technologies for musical applications, Musical mapping algorithms and intelligent controllers, Pure Data.},
 pages = {39--42},
 title = {Real-time Gesture Mapping in Pd Environment using Neural Networks},
 url = {http://www.nime.org/proceedings/2004/nime2004_039.pdf},
 year = {2004}
}