Ha Dou Ken Music: Different mappings to play music with joysticks

Gabriel Lopes Rocha, João Teixera Araújo, and Flávio Luiz Schiavoni

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2019
• Location: Porto Alegre, Brazil
• Pages: 77–78
• DOI: 10.5281/zenodo.3672872 (Link to paper)
• PDF link

Abstract:

Due to video game controls great presence in popular culture and its ease of access, even people who are not in the habit of playing electronic games possibly interacted with this kind of interface once in a lifetime. Thus, gestures like pressing a sequence of buttons, pressing them simultaneously or sliding your fingers through the control can be mapped for musical creation. This work aims the elaboration of a strategy in which several gestures performed in a joystick control can influence one or several parameters of the sound synthesis, making a mapping denominated many to many. Buttons combinations used to perform game actions that are common in fighting games, like Street Fighter, were mapped to the synthesizer to create a music. Experiments show that this mapping is capable of influencing the musical expression of a DMI making it closer to an acoustic instrument.

Citation:

BibTeX Entry:

  @inproceedings{Rocha2019,
 abstract = {Due to video game controls great presence in popular culture and its ease of access, even people who are not in the habit of playing electronic games possibly interacted with this kind of interface once in a lifetime. Thus, gestures like pressing a sequence of buttons, pressing them simultaneously or sliding your fingers through the control can be mapped for musical creation. This work aims the elaboration of a strategy in which several gestures performed in a joystick control can influence one or several parameters of the sound synthesis, making a mapping denominated many to many. Buttons combinations used to perform game actions that are common in fighting games, like Street Fighter, were mapped to the synthesizer to create a music. Experiments show that this mapping is capable of influencing the musical expression of a DMI making it closer to an acoustic instrument.},
 address = {Porto Alegre, Brazil},
 author = {Gabriel Lopes Rocha and João Teixera Araújo and Flávio Luiz Schiavoni},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.3672872},
 editor = {Marcelo Queiroz and Anna Xambó Sedó},
 issn = {2220-4806},
 month = {June},
 pages = {77--78},
 publisher = {UFRGS},
 title = {Ha Dou Ken Music: Different mappings to play music with joysticks},
 url = {http://www.nime.org/proceedings/2019/nime2019_paper015.pdf},
 year = {2019}
}