Using MIDI to Modify Video Game Content

Jukka Holm, Juha Arrasvuori, and Kai Havukainen

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2006
• Location: Paris, France
• Pages: 65–70
• Keywords: Games, MIDI, music, rhythm games, background music reactive games, musically controlled games, MIDI-controlled games, Virtual Sequencer.
• DOI: 10.5281/zenodo.1176925 (Link to paper)
• PDF link

Abstract:

This paper discusses the concept of using background music to control video game parameters and thus actions on the screen. Each song selected by the player makes the game look different and behave variedly. The concept is explored by modifying an existing video game and playtesting it with different kinds of MIDI music. Several examples of mapping MIDI parameters to game events are presented. As mobile phones' MIDI players do not usually have a dedicated callback API, a real-time MIDI analysis software for Symbian OS was implemented. Future developments including real-time group performance as a way to control game content are also considered.

Citation:

BibTeX Entry:

  @inproceedings{Holm2006,
 abstract = {This paper discusses the concept of using background music to control video game parameters and thus actions on the screen. Each song selected by the player makes the game look different and behave variedly. The concept is explored by modifying an existing video game and playtesting it with different kinds of MIDI music. Several examples of mapping MIDI parameters to game events are presented. As mobile phones' MIDI players do not usually have a dedicated callback API, a real-time MIDI analysis software for Symbian OS was implemented. Future developments including real-time group performance as a way to control game content are also considered. },
 address = {Paris, France},
 author = {Holm, Jukka and Arrasvuori, Juha and Havukainen, Kai},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176925},
 issn = {2220-4806},
 keywords = {Games, MIDI, music, rhythm games, background music reactive games, musically controlled games, MIDI-controlled games, Virtual Sequencer. },
 pages = {65--70},
 title = {Using {MIDI} to Modify Video Game Content},
 url = {http://www.nime.org/proceedings/2006/nime2006_065.pdf},
 year = {2006}
}