The Perception of Live-sequenced Electronic Music via Hearing and Sight

Mehmet Aydin Baytas, Tilbe Goksun, and Oguzhan Ozcan

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

In this paper, we investigate how watching a live-sequenced electronic music performance, compared to merely hearing the music, contributes to spectators' experiences of tension. We also explore the role of the performers' effective and ancillary gestures in conveying tension, when they can be seen. To this end, we conducted an experiment where 30 participants heard, saw, or both heard and saw a live-sequenced techno music performance recording while they produced continuous judgments on their experience of tension. Eye tracking data was also recorded from participants who saw the visuals, to reveal aspects of the performance that influenced their tension judgments. We analysed the data to explore how auditory and visual components and the performer's movements contribute to spectators' experience of tension. Our results show that their perception of emotional intensity is consistent across hearing and sight, suggesting that gestures in live-sequencing can be a medium for expressive performance.

Citation:

Mehmet Aydin Baytas, Tilbe Goksun, and Oguzhan Ozcan. 2016. The Perception of Live-sequenced Electronic Music via Hearing and Sight. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1175978

BibTeX Entry:

  @inproceedings{Baytas2016,
 abstract = {In this paper, we investigate how watching a live-sequenced
electronic music performance, compared to merely hearing the music, contributes
to spectators' experiences of tension. We also explore the role of the
performers' effective and ancillary gestures in conveying tension, when they can
be seen. To this end, we conducted an experiment where 30 participants heard,
saw, or both heard and saw a live-sequenced techno music performance recording
while they produced continuous judgments on their experience of tension. Eye
tracking data was also recorded from participants who saw the visuals, to reveal
aspects of the performance that influenced their tension judgments. We analysed
the data to explore how auditory and visual components and the performer's
movements contribute to spectators' experience of tension. Our results show that
their perception of emotional intensity is consistent across hearing and sight,
suggesting that gestures in live-sequencing can be a medium
for expressive performance.},
 address = {Brisbane, Australia},
 author = {Baytas, Mehmet Aydin and Tilbe Goksun and Oguzhan Ozcan},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1175978},
 isbn = {978-1-925455-13-7},
 issn = {2220-4806},
 pages = {194--199},
 publisher = {Queensland Conservatorium Griffith University},
 title = {The Perception of Live-sequenced Electronic Music via Hearing and Sight},
 track = {Papers},
 url = {http://www.nime.org/proceedings/2016/nime2016_paper0040.pdf},
 year = {2016}
}