Combining Accelerometer and Video Camera: Reconstruction of Bow Velocity Profiles

Erwin Schoonderwaldt, Nicolas Rasamimanana, and Frédéric Bevilacqua

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

A cost-effective method was developed for the estimation of the bow velocity in violin playing, using an accelerometer on the bow in combination with point tracking using a standard video camera. The video data are used to detect the moments of bow direction changes. This information is used for piece-wise integration of the accelerometer signal, resulting in a drift-free reconstructed velocity signal with a high temporal resolution. The method was evaluated using a 3D motion capturing system, providing a reliable reference of the actual bow velocity. The method showed good results when the accelerometer and video stream are synchronized. Additional latency and jitter of the camera stream can importantly decrease the performance of the method, depending on the bow stroke type.

Citation:

Erwin Schoonderwaldt, Nicolas Rasamimanana, and Frédéric Bevilacqua. 2006. Combining Accelerometer and Video Camera: Reconstruction of Bow Velocity Profiles. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177003

BibTeX Entry:

  @inproceedings{Schoonderwaldt2006,
 abstract = {A cost-effective method was developed for the estimation of the bow velocity in violin playing, using an accelerometer on the bow in combination with point tracking using a standard video camera. The video data are used to detect the moments of bow direction changes. This information is used for piece-wise integration of the accelerometer signal, resulting in a drift-free reconstructed velocity signal with a high temporal resolution. The method was evaluated using a 3D motion capturing system, providing a reliable reference of the actual bow velocity. The method showed good results when the accelerometer and video stream are synchronized. Additional latency and jitter of the camera stream can importantly decrease the performance of the method, depending on the bow stroke type. },
 address = {Paris, France},
 author = {Schoonderwaldt, Erwin and Rasamimanana, Nicolas and Bevilacqua, Fr\'{e}d\'{e}ric},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177003},
 issn = {2220-4806},
 keywords = {Bowing gestures, bowed string, violin, bow velocity, accelerometer, video tracking. },
 pages = {200--203},
 title = {Combining Accelerometer and Video Camera: Reconstruction of Bow Velocity Profiles},
 url = {http://www.nime.org/proceedings/2006/nime2006_200.pdf},
 year = {2006}
}