Cross-Modal Terrains: Navigating Sonic Space through Haptic Feedback
Gabriella Isaac, Lauren Hayes, and Todd Ingalls
Proceedings of the International Conference on New Interfaces for Musical Expression
- Year: 2017
- Location: Copenhagen, Denmark
- Pages: 38–41
- DOI: 10.5281/zenodo.1176163 (Link to paper)
- PDF link
Abstract
This paper explores the idea of using virtual textural terrains as a means of generating haptic profiles for force-feedback controllers. This approach breaks from the paradigm established within audio-haptic research over the last few decades where physical models within virtual environments are designed to transduce gesture into sonic output. We outline a method for generating multimodal terrains using basis functions, which are rendered into monochromatic visual representations for inspection. This visual terrain is traversed using a haptic controller, the NovInt Falcon, which in turn receives force information based on the grayscale value of its location in this virtual space. As the image is traversed by a performer the levels of resistance vary, and the image is realized as a physical terrain. We discuss the potential of this approach to afford engaging musical experiences for both the performer and the audience as iterated through numerous performances.
Citation
Gabriella Isaac, Lauren Hayes, and Todd Ingalls. 2017. Cross-Modal Terrains: Navigating Sonic Space through Haptic Feedback. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1176163
BibTeX Entry
@inproceedings{gisaac2017, abstract = {This paper explores the idea of using virtual textural terrains as a means of generating haptic profiles for force-feedback controllers. This approach breaks from the paradigm established within audio-haptic research over the last few decades where physical models within virtual environments are designed to transduce gesture into sonic output. We outline a method for generating multimodal terrains using basis functions, which are rendered into monochromatic visual representations for inspection. This visual terrain is traversed using a haptic controller, the NovInt Falcon, which in turn receives force information based on the grayscale value of its location in this virtual space. As the image is traversed by a performer the levels of resistance vary, and the image is realized as a physical terrain. We discuss the potential of this approach to afford engaging musical experiences for both the performer and the audience as iterated through numerous performances.}, address = {Copenhagen, Denmark}, author = {Gabriella Isaac and Lauren Hayes and Todd Ingalls}, booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression}, doi = {10.5281/zenodo.1176163}, issn = {2220-4806}, pages = {38--41}, publisher = {Aalborg University Copenhagen}, title = {Cross-Modal Terrains: Navigating Sonic Space through Haptic Feedback}, url = {http://www.nime.org/proceedings/2017/nime2017_paper0008.pdf}, year = {2017} }