The Web Browser As Synthesizer And Interface

Charles Roberts, Graham Wakefield, and Matthew Wright

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract:

Web technologies provide an incredible opportunity to present new musicalinterfaces to new audiences. Applications written in JavaScript and designed torun in the browser offer remarkable performance, mobile/desktop portability andlongevity due to standardization. Our research examines the use and potentialof native web technologies for musical expression. We introduce two librariestowards this end: Gibberish.js, a heavily optimized audio DSP library, andInterface.js, a GUI toolkit that works with mouse, touch and motion events.Together these libraries provide a complete system for defining musicalinstruments that can be used in both desktop and mobile browsers. Interface.jsalso enables control of remote synthesis applications by including anapplication that translates the socket protocol used by browsers into both MIDIand OSC messages.

Citation:

Charles Roberts, Graham Wakefield, and Matthew Wright. 2013. The Web Browser As Synthesizer And Interface. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.1178648

BibTeX Entry:

  @inproceedings{Roberts2013a,
 abstract = {Web technologies provide an incredible opportunity to present new musicalinterfaces to new audiences. Applications written in JavaScript and designed torun in the browser offer remarkable performance, mobile/desktop portability andlongevity due to standardization. Our research examines the use and potentialof native web technologies for musical expression. We introduce two librariestowards this end: Gibberish.js, a heavily optimized audio DSP library, andInterface.js, a GUI toolkit that works with mouse, touch and motion events.Together these libraries provide a complete system for defining musicalinstruments that can be used in both desktop and mobile browsers. Interface.jsalso enables control of remote synthesis applications by including anapplication that translates the socket protocol used by browsers into both MIDIand OSC messages.},
 address = {Daejeon, Republic of Korea},
 author = {Charles Roberts and Graham Wakefield and Matthew Wright},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1178648},
 issn = {2220-4806},
 keywords = {mobile devices, javascript, browser-based NIMEs, web audio, websockets},
 month = {May},
 pages = {313--318},
 publisher = {Graduate School of Culture Technology, KAIST},
 title = {The Web Browser As Synthesizer And Interface},
 url = {http://www.nime.org/proceedings/2013/nime2013_282.pdf},
 year = {2013}
}