Measurement of Latency in Interactive Multimedia Art

Yoichi Nagashima

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper, I would like to introduce my experimental study of multimedia psychology. My initial focus of investigation is the interaction between perceptions of auditory and visual beats. When the musical and graphical beats are completely synchronized with each other, as in a music video for promotional purposes, the audience feels that they are natural and comforting. My initial experiment has proved that the actual tempos of music and images are a little different. If a slight timelag exists between the musical and pictorial beats, the audience tries to keep them in synchronization by unconsciously changing the interpretation of the time-based beat points. As the lag increases over time, the audience seems to perceive that the beat synchronization has changed from being more downbeat to more upbeat, and continues enjoying it. I have developed an experiment system that can generateand control out-of-phase visual and auditory beats in real time, and have tested many subjects with it. This paper describes the measurement of time lags generated in the experiment system, as part of my psychological experiment.

Citation:

Yoichi Nagashima. 2004. Measurement of Latency in Interactive Multimedia Art. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176641

BibTeX Entry:

  @inproceedings{Nagashima2004,
 abstract = {In this paper, I would like to introduce my experimental study of multimedia psychology. My initial focus of investigation is the interaction between perceptions of auditory and visual beats. When the musical and graphical beats are completely synchronized with each other, as in a music video for promotional purposes, the audience feels that they are natural and comforting. My initial experiment has proved that the actual tempos of music and images are a little different. If a slight timelag exists between the musical and pictorial beats, the audience tries to keep them in synchronization by unconsciously changing the interpretation of the time-based beat points. As the lag increases over time, the audience seems to perceive that the beat synchronization has changed from being more downbeat to more upbeat, and continues enjoying it. I have developed an experiment system that can generateand control out-of-phase visual and auditory beats in real time, and have tested many subjects with it. This paper describes the measurement of time lags generated in the experiment system, as part of my psychological experiment.},
 address = {Hamamatsu, Japan},
 author = {Nagashima, Yoichi},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176641},
 issn = {2220-4806},
 pages = {173--176},
 title = {Measurement of Latency in Interactive Multimedia Art},
 url = {http://www.nime.org/proceedings/2004/nime2004_173.pdf},
 year = {2004}
}