CubeHarmonic: A New Interface from a Magnetic 3D Motion Tracking System to Music Performance

Maria C. Mannone, Eri Kitamura, Jiawei Huang, Ryo Sugawara, and Yoshifumi Kitamura

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2018
• Location: Blacksburg, Virginia, USA
• Pages: 350–351
• DOI: 10.5281/zenodo.1302615 (Link to paper)
• PDF link

Abstract:

We developed a new musical interface, CubeHarmonic, with the magnetic tracking system, IM3D, created at Tohoku University. IM3D system precisely tracks positions of tiny, wireless, battery-less, and identifiable LC coils in real time. The CubeHarmonic is a musical application of the Rubik's cube, with notes on each little piece. Scrambling the cube, we get different chords and chord sequences. Positions of the pieces which contain LC coils are detected through IM3D, and transmitted to the computer, that plays sounds. The central position of the cube is also computed from the LC coils located into the corners of Rubik's cube, and, depending on the computed central position, we can manipulate overall loudness and pitch changes, as in theremin playing. This new instrument, whose first idea comes from mathematical theory of music, can be used as a teaching tool both for math (group theory) and music (music theory, mathematical music theory), as well as a composition device, a new instrument for avant-garde performances, and a recreational tool.

Citation:

BibTeX Entry:

  @inproceedings{Mannone2018,
 abstract = {We developed a new musical interface, CubeHarmonic, with the magnetic tracking system, IM3D, created at Tohoku University. IM3D system precisely tracks positions of tiny, wireless, battery-less, and identifiable LC coils in real time. The CubeHarmonic is a musical application of the Rubik's cube, with notes on each little piece. Scrambling the cube, we get different chords and chord sequences. Positions of the pieces which contain LC coils are detected through IM3D, and transmitted to the computer, that plays sounds. The central position of the cube is also computed from the LC coils located into the corners of Rubik's cube, and, depending on the computed central position, we can manipulate overall loudness and pitch changes, as in theremin playing. This new instrument, whose first idea comes from mathematical theory of music, can be used as a teaching tool both for math (group theory) and music (music theory, mathematical music theory), as well as a composition device, a new instrument for avant-garde performances, and a recreational tool.},
 address = {Blacksburg, Virginia, USA},
 author = {Maria C. Mannone and Eri Kitamura and Jiawei Huang and Ryo Sugawara and Yoshifumi Kitamura},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1302615},
 editor = {Luke Dahl, Douglas Bowman, Thomas Martin},
 isbn = {978-1-949373-99-8},
 issn = {2220-4806},
 month = {June},
 pages = {350--351},
 publisher = {Virginia Tech},
 title = {CubeHarmonic: A New Interface from a Magnetic 3D Motion Tracking System to Music Performance},
 url = {http://www.nime.org/proceedings/2018/nime2018_paper0076.pdf},
 year = {2018}
}