Participatory Conceptual Design of Accessible Digital Musical Instruments using Generative AI

Hugh Aynsley, Tom Mitchell, and Dave Meckin

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

This paper explores the potential of AI text-to-image diffusion models (e.g. DALLE-2 and Midjourney) to support the early phase design of new digital musical instruments in collaboration with Disabled musicians. The paper presents initial findings from two speculative design workshops attended by Disabled participants who are affiliated with the London-based inclusive arts organisation Joy of Sound. The workshops included activities enabling participants to co-create speculative images of new instruments, drawing on their contributions. These included the overall appearance of the instrument, constituent materials and other design characteristics. The paper discusses the generated images and examines how diffusion models can be a useful tool to support the conceptual co-design phase of bespoke accessible instruments. The project findings indicate that diffusion models can be useful as a facilitatory tool for idea generation in the initial stages of bespoke instrument design.

Citation:

Hugh Aynsley, Tom Mitchell, and Dave Meckin. 2023. Participatory Conceptual Design of Accessible Digital Musical Instruments using Generative AI. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.11189302

BibTeX Entry:

  @inproceedings{nime2023_83,
 abstract = {This paper explores the potential of AI text-to-image diffusion models (e.g. DALLE-2 and Midjourney) to support the early phase design of new digital musical instruments in collaboration with Disabled musicians. The paper presents initial findings from two speculative design workshops attended by Disabled participants who are affiliated with the London-based inclusive arts organisation Joy of Sound. The workshops included activities enabling participants to co-create speculative images of new instruments, drawing on their contributions. These included the overall appearance of the instrument, constituent materials and other design characteristics. The paper discusses the generated images and examines how diffusion models can be a useful tool to support the conceptual co-design phase of bespoke accessible instruments. The project findings indicate that diffusion models can be useful as a facilitatory tool for idea generation in the initial stages of bespoke instrument design.},
 address = {Mexico City, Mexico},
 articleno = {83},
 author = {Hugh Aynsley and Tom Mitchell and Dave Meckin},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.11189302},
 editor = {Miguel Ortiz and Adnan Marquez-Borbon},
 issn = {2220-4806},
 month = {May},
 numpages = {5},
 pages = {579--583},
 title = {Participatory Conceptual Design of Accessible Digital Musical Instruments using Generative AI},
 track = {Work in Progress},
 url = {http://nime.org/proceedings/2023/nime2023_83.pdf},
 year = {2023}
}