Do We Speak Sensor? Cultural Constraints of Embodied Interaction

Jon Pigrem, and Andrew P. McPherson

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper explores the role of materiality in Digital Musical Instruments and questions the influence of tacit understandings of sensor technology. Existing research investigates the use of gesture, physical interaction and subsequent parameter mapping. We suggest that a tacit knowledge of the ‘sensor layer' brings with it definitions, understandings and expectations that forge and guide our approach to interaction. We argue that the influence of technology starts before a sound is made, and comes from not only intuition of material properties, but also received notions of what technology can and should do. On encountering an instrument with obvious sensors, a potential performer will attempt to predict what the sensors do and what the designer intends for them to do, becoming influenced by a machine centered understanding of interaction and not a solely material centred one. The paper presents an observational study of interaction using non-functional prototype instruments designed to explore fundamental ideas and understandings of instrumental interaction in the digital realm. We will show that this understanding influences both gestural language and ability to characterise an expected sonic/musical response.

Citation:

Jon Pigrem, and Andrew P. McPherson. 2018. Do We Speak Sensor? Cultural Constraints of Embodied Interaction . Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1302633

BibTeX Entry:

  @inproceedings{Pigrem2018,
 abstract = {This paper explores the role of materiality in Digital Musical Instruments and questions the influence of tacit understandings of sensor technology. Existing research investigates the use of gesture, physical interaction and subsequent parameter mapping. We suggest that a tacit knowledge of the ‘sensor layer' brings with it definitions, understandings and expectations that forge and guide our approach to interaction. We argue that the influence of technology starts before a sound is made, and comes from not only intuition of material properties, but also received notions of what technology can and should do. On encountering an instrument with obvious sensors, a potential performer will attempt to predict what the sensors do and what the designer intends for them to do, becoming influenced by a machine centered understanding of interaction and not a solely material centred one. The paper presents an observational study of interaction using non-functional prototype instruments designed to explore fundamental ideas and understandings of instrumental interaction in the digital realm. We will show that this understanding influences both gestural language and ability to characterise an expected sonic/musical response. },
 address = {Blacksburg, Virginia, USA},
 author = {Jon Pigrem and McPherson, Andrew P.},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1302633},
 editor = {Luke Dahl, Douglas Bowman, Thomas Martin},
 isbn = {978-1-949373-99-8},
 issn = {2220-4806},
 month = {June},
 pages = {382--385},
 publisher = {Virginia Tech},
 title = {Do We Speak Sensor? Cultural Constraints of Embodied Interaction },
 url = {http://www.nime.org/proceedings/2018/nime2018_paper0085.pdf},
 year = {2018}
}