Wireless Interactive Sensor Platform for Real-Time Audio-Visual Experience

Jia-Liang Lu, Da-Lei Fang, Yi Qin, and Jiu-Qiang Tang

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

WIS platform is a wireless interactive sensor platform de-signed to support dynamic and interactive applications. The platform consists of a capture system which includes multi-ple on-body Zigbee compatible motion sensors, a processing unit and an audio-visual display control unit. It has a com-plete open architecture and provides interfaces to interact with other user-designed applications. Therefore, WIS plat-form is highly extensible. Through gesture recognitions by on-body sensor nodes and data processing, WIS platform can offer real-time audio and visual experiences to the users. Based on this platform, we set up a multimedia installation that presents a new interaction model between the partic-ipants and the audio-visual environment. Furthermore, we are also trying to apply WIS platform to other installations and performances.

Citation

Jia-Liang Lu, Da-Lei Fang, Yi Qin, and Jiu-Qiang Tang. 2012. Wireless Interactive Sensor Platform for Real-Time Audio-Visual Experience. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178329

BibTeX Entry

@inproceedings{Lu2012,
 abstract = {WIS platform is a wireless interactive sensor platform de-signed to support dynamic and interactive applications. The platform consists of a capture system which includes multi-ple on-body Zigbee compatible motion sensors, a processing unit and an audio-visual display control unit. It has a com-plete open architecture and provides interfaces to interact with other user-designed applications. Therefore, WIS plat-form is highly extensible. Through gesture recognitions by on-body sensor nodes and data processing, WIS platform can offer real-time audio and visual experiences to the users. Based on this platform, we set up a multimedia installation that presents a new interaction model between the partic-ipants and the audio-visual environment. Furthermore, we are also trying to apply WIS platform to other installations and performances.},
 address = {Ann Arbor, Michigan},
 author = {Jia-Liang Lu and Da-Lei Fang and Yi Qin and Jiu-Qiang Tang},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178329},
 issn = {2220-4806},
 keywords = {Interactive, Audio-visual experience},
 publisher = {University of Michigan},
 title = {Wireless Interactive Sensor Platform for Real-Time Audio-Visual Experience},
 url = {http://www.nime.org/proceedings/2012/nime2012_98.pdf},
 year = {2012}
}