Gestus: Teaching Soundscape Composition and Performance with a Tangible Interface

Stratos Kountouras, and Ioannis Zannos

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Tangible user interfaces empower artists, boost their creative expression and enhance performing art. However, most of them are designed to work with a set of rules, many of which require advanced skills and target users above a certain age. Here we present a comparative and quantitative study of using TUIs as an alternative teaching tool in experimenting with and creating soundscapes with children. We describe an informal interactive workshop involving schoolchildren. We focus on the development of playful uses of technology to help children empirically understand audio feature extraction basic techniques. We promote tangible interaction as an alternative learning method in the creation of synthetic soundscape based on sounds recorded in a natural outdoor environment as main sources of sound. We investigate how schoolchildren perceive natural sources of sound and explore practices that reuse prerecorded material through a tangible interactive controller. We discuss the potential benefits of using TUIs as an alternative empirical method for tangible learning and interaction design, and its impact on encouraging and motivating creativity in children. We summarize our findings and review children's biehavioural indicators of engagement and enjoyment in order to provide insight to the design of TUIs based on user experience.

Citation:

Stratos Kountouras, and Ioannis Zannos. 2017. Gestus: Teaching Soundscape Composition and Performance with a Tangible Interface. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176274

BibTeX Entry:

  @inproceedings{skountouras2017,
 abstract = {Tangible user interfaces empower artists, boost their creative expression and enhance performing art. However, most of them are designed to work with a set of rules, many of which require advanced skills and target users above a certain age. Here we present a comparative and quantitative study of using TUIs as an alternative teaching tool in experimenting with and creating soundscapes with children. We describe an informal interactive workshop involving schoolchildren. We focus on the development of playful uses of technology to help children empirically understand audio feature extraction basic techniques. We promote tangible interaction as an alternative learning method in the creation of synthetic soundscape based on sounds recorded in a natural outdoor environment as main sources of sound. We investigate how schoolchildren perceive natural sources of sound and explore practices that reuse prerecorded material through a tangible interactive controller. We discuss the potential benefits of using TUIs as an alternative empirical method for tangible learning and interaction design, and its impact on encouraging and motivating creativity in children. We summarize our findings and review children's biehavioural indicators of engagement and enjoyment in order to provide insight to the design of TUIs based on user experience.},
 address = {Copenhagen, Denmark},
 author = {Stratos Kountouras and Ioannis Zannos},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1176274},
 issn = {2220-4806},
 pages = {336--341},
 publisher = {Aalborg University Copenhagen},
 title = {Gestus: Teaching Soundscape Composition and Performance with a Tangible Interface},
 url = {http://www.nime.org/proceedings/2017/nime2017_paper0064.pdf},
 year = {2017}
}