Kinetic Particles Synthesizer Using Multi-Touch Screen Interface of Mobile Devices

Yasuo Kuhara, and Daiki Kobayashi

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

We developed a kinetic particles synthesizer for mobile devices having a multi-touch screen such as a tablet PC and a smart phone. This synthesizer generates music based on the kinetics of particles under a two-dimensional physics engine. The particles move in the screen to synthesize sounds according to their own physical properties, which are shape, size, mass, linear and angular velocity, friction, restitution, etc. If a particle collides with others, a percussive sound is generated. A player can play music by the simple operation of touching or dragging on the screen of the device. Using a three-axis acceleration sensor, a player can perform music by shuffling or tilting the device. Each particle sounds just a simple tone. However, a large amount of various particles play attractive music by aggregating their sounds. This concept has been inspired by natural sounds made from an assembly of simple components, for example, rustling leaves or falling rain. For a novice who has no experience of playing a musical instrument, it is easy to learn how to play instantly and enjoy performing music with intuitive operation. Our system is used for musical instruments for interactive music entertainment.

Citation:

Yasuo Kuhara, and Daiki Kobayashi. 2011. Kinetic Particles Synthesizer Using Multi-Touch Screen Interface of Mobile Devices. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178079

BibTeX Entry:

  @inproceedings{Kuhara2011,
 abstract = {We developed a kinetic particles synthesizer for mobile devices having a multi-touch screen such as a tablet PC and a smart phone. This synthesizer generates music based on the kinetics of particles under a two-dimensional physics engine. The particles move in the screen to synthesize sounds according to their own physical properties, which are shape, size, mass, linear and angular velocity, friction, restitution, etc. If a particle collides with others, a percussive sound is generated. A player can play music by the simple operation of touching or dragging on the screen of the device. Using a three-axis acceleration sensor, a player can perform music by shuffling or tilting the device. Each particle sounds just a simple tone. However, a large amount of various particles play attractive music by aggregating their sounds. This concept has been inspired by natural sounds made from an assembly of simple components, for example, rustling leaves or falling rain. For a novice who has no experience of playing a musical instrument, it is easy to learn how to play instantly and enjoy performing music with intuitive operation. Our system is used for musical instruments for interactive music entertainment. },
 address = {Oslo, Norway},
 author = {Kuhara, Yasuo and Kobayashi, Daiki},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178079},
 issn = {2220-4806},
 keywords = {Particle, Tablet PC, iPhone, iPod touch, iPad, Smart phone, Kinetics, Touch screen, Physics engine. },
 pages = {136--137},
 title = {Kinetic Particles Synthesizer Using Multi-Touch Screen Interface of Mobile Devices},
 url = {http://www.nime.org/proceedings/2011/nime2011_136.pdf},
 year = {2011}
}