Hé : Calligraphy as a Musical Interface

Laewoo Kang, and Hsin-Yi Chien

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

The project Hé(和, harmony) is a sound installation that enables a user to play music by writing calligraphy. We developed a system where calligraphic symbols can be detected and converted to a sound composed of pitch, pitch length, and volume though MIDI and serial communication. The Hé sound installation involves a micro-controller, photocells, and multiplexers. A DC motor controls the speed of a spooled paper roll that is capable of setting the music tempo. This paper presents the design concept and implementation of Hé. We discuss the major research issues such as using photocells for detecting components of calligraphy like thickness and location. Hardware and software details are also discussed. Finally, we explore the potential for further extending musical and visual experience through this project’s applications and outcomes.

Citation:

Laewoo Kang, and Hsin-Yi Chien. 2010. Hé : Calligraphy as a Musical Interface. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1177819

BibTeX Entry:

  @inproceedings{Kang2010,
 abstract = {The project H\'{e}(和, harmony) is a sound installation that enables a user to play music by writing calligraphy. We developed a system where calligraphic symbols can be detected and converted to a sound composed of pitch, pitch length, and volume though MIDI and serial communication. The H\'{e} sound installation involves a micro-controller, photocells, and multiplexers. A DC motor controls the speed of a spooled paper roll that is capable of setting the music tempo. This paper presents the design concept and implementation of H\'{e}. We discuss the major research issues such as using photocells for detecting components of calligraphy like thickness and location. Hardware and software details are also discussed. Finally, we explore the potential for further extending musical and visual experience through this project’s applications and outcomes.},
 address = {Sydney, Australia},
 author = {Kang, Laewoo and Chien, Hsin-Yi},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1177819},
 issn = {2220-4806},
 keywords = {Interactive music interface, calligraphy, graphical music composing, sonification},
 pages = {352--355},
 title = {H\'{e} : Calligraphy as a Musical Interface},
 url = {http://www.nime.org/proceedings/2010/nime2010_352.pdf},
 year = {2010}
}