Squeeze, Twist, Stretch: Exploring Deformable Digital Musical Interfaces Design Through Non-Functional Prototypes

Jianing Zheng, and Nick Bryan-Kinns

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2022
• Location: The University of Auckland, New Zealand
• Article Number: 7
• DOI: 10.21428/92fbeb44.41da9da5 (Link to paper)
• PDF link
• Presentation Video

Abstract:

Deformable interfaces are an emerging area of Human- Computer Interaction (HCI) research that offers nuanced and responsive physical interaction with digital technologies. They are well suited to creative and expressive forms of HCI such as Digital Musical Interfaces (DMIs). However, research on the design of deformable DMIs is limited. This paper explores the role that deformable interfaces might play in DMI design. We conducted an online study with 23 DMI designers in which they were invited to create non-functional deformable DMIs together. Our results suggest forms of gestural input and sound mappings that deformable interfaces intuitively lend themselves to for DMI design. From our results, we highlight four styles of DMI that deformable interfaces might be most suited to, and suggest the kinds of experience that deformable DMIs might be most compelling for musicians and audiences. We discuss how DMI designers explore deformable materials and gestures input and the role of unexpected affordances in the design process.

Citation:

BibTeX Entry:

  @inproceedings{NIME22_7,
 abstract = {Deformable interfaces are an emerging area of Human- Computer Interaction (HCI) research that offers nuanced and responsive physical interaction with digital technologies. They are well suited to creative and expressive forms of HCI such as Digital Musical Interfaces (DMIs). However, research on the design of deformable DMIs is limited. This paper explores the role that deformable interfaces might play in DMI design. We conducted an online study with 23 DMI designers in which they were invited to create non-functional deformable DMIs together. Our results suggest forms of gestural input and sound mappings that deformable interfaces intuitively lend themselves to for DMI design. From our results, we highlight four styles of DMI that deformable interfaces might be most suited to, and suggest the kinds of experience that deformable DMIs might be most compelling for musicians and audiences. We discuss how DMI designers explore deformable materials and gestures input and the role of unexpected affordances in the design process.},
 address = {The University of Auckland, New Zealand},
 articleno = {7},
 author = {Zheng, Jianing and Bryan-Kinns, Nick},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.21428/92fbeb44.41da9da5},
 issn = {2220-4806},
 month = {jun},
 pdf = {111.pdf},
 presentation-video = {https://youtu.be/KHqfxL4F7Bg},
 title = {Squeeze, Twist, Stretch: Exploring Deformable Digital Musical Interfaces Design Through Non-Functional Prototypes},
 url = {https://doi.org/10.21428%2F92fbeb44.41da9da5},
 year = {2022}
}