Computer Assisted Melo-rhythmic Generation of Traditional Chinese Music from Ink Brush Calligraphy

Will W. W. Tang, Stephen Chan, Grace Ngai, and Hong-va Leong

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

CalliMusic, is a system developed for users to generate traditional Chinesemusic by writing Chinese ink brush calligraphy, turning the long-believedstrong linkage between the two art forms with rich histories into reality. Inaddition to traditional calligraphy writing instruments (brush, ink and paper),a camera is the only addition needed to convert the motion of the ink brushinto musical notes through a variety of mappings such as human-inspired,statistical and a hybrid. The design of the system, including details of eachmapping and research issues encountered are discussed. A user study of systemperformance suggests that the result is quite encouraging. The technique is,obviously, applicable to other related art forms with a wide range ofapplications.

Citation:

Will W. W. Tang, Stephen Chan, Grace Ngai, and Hong-va Leong. 2013. Computer Assisted Melo-rhythmic Generation of Traditional Chinese Music from Ink Brush Calligraphy. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178668

BibTeX Entry:

  @inproceedings{Tang2013,
 abstract = {CalliMusic, is a system developed for users to generate traditional Chinesemusic by writing Chinese ink brush calligraphy, turning the long-believedstrong linkage between the two art forms with rich histories into reality. Inaddition to traditional calligraphy writing instruments (brush, ink and paper),a camera is the only addition needed to convert the motion of the ink brushinto musical notes through a variety of mappings such as human-inspired,statistical and a hybrid. The design of the system, including details of eachmapping and research issues encountered are discussed. A user study of systemperformance suggests that the result is quite encouraging. The technique is,obviously, applicable to other related art forms with a wide range ofapplications.},
 address = {Daejeon, Republic of Korea},
 author = {Will W. W. Tang and Stephen Chan and Grace Ngai and Hong-va Leong},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178668},
 issn = {2220-4806},
 keywords = {Chinese Calligraphy, Chinese Music, Assisted Music Generation},
 month = {May},
 pages = {84--89},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {Computer Assisted Melo-rhythmic Generation of Traditional Chinese Music from Ink Brush Calligraphy},
 url = {http://www.nime.org/proceedings/2013/nime2013_208.pdf},
 year = {2013}
}