MalLo: A Distributed Synchronized Musical Instrument Designed For Internet Performance

Zeyu Jin, Reid Oda, Adam Finkelstein, and Rebecca Fiebrink

Proceedings of the International Conference on New Interfaces for Musical Expression

• Year: 2015
• Location: Baton Rouge, Louisiana, USA
• Pages: 293–298
• DOI: 10.5281/zenodo.1179102 (Link to paper)
• PDF link
• Supplementary File 1: 0223-file1.mp4

Abstract:

The Internet holds a lot of potential as a music listening, collaboration, and performance space. It has become commonplace to stream music and video of musical performance over the web. However, the goal of playing rhythmically synchronized music over long distances has remained elusive due to the latency inherent in networked communication. The farther apart two artists are from one another, the greater the delay. Furthermore, latency times can change abruptly with no warning. In this paper, we demonstrate that it is possible to create a distributed, synchronized musical instrument that allows performers to play together over long distances, despite latency. We describe one such instrument, MalLo, which combats latency by predicting a musician's action before it is completed. MalLo sends information about a predicted musical note over the Internet before it is played, and synthesizes this note at a collaborator's location at nearly the same moment it is played by the performer. MalLo also protects against latency spikes by sending the prediction data across multiple network paths, with the intention of routing around latency.

Citation:

BibTeX Entry:

  @inproceedings{roda2015,
 abstract = {The Internet holds a lot of potential as a music listening, collaboration, and performance space. It has become commonplace to stream music and video of musical performance over the web. However, the goal of playing rhythmically synchronized music over long distances has remained elusive due to the latency inherent in networked communication. The farther apart two artists are from one another, the greater the delay. Furthermore, latency times can change abruptly with no warning. In this paper, we demonstrate that it is possible to create a distributed, synchronized musical instrument that allows performers to play together over long distances, despite latency. We describe one such instrument, MalLo, which combats latency by predicting a musician's action before it is completed. MalLo sends information about a predicted musical note over the Internet before it is played, and synthesizes this note at a collaborator's location at nearly the same moment it is played by the performer. MalLo also protects against latency spikes by sending the prediction data across multiple network paths, with the intention of routing around latency. },
 address = {Baton Rouge, Louisiana, USA},
 author = {Zeyu Jin and Reid Oda and Adam Finkelstein and Rebecca Fiebrink},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.1179102},
 editor = {Edgar Berdahl and Jesse Allison},
 issn = {2220-4806},
 month = {May},
 pages = {293--298},
 publisher = {Louisiana State University},
 title = {MalLo: A Distributed Synchronized Musical Instrument Designed For Internet Performance},
 url = {http://www.nime.org/proceedings/2015/nime2015_223.pdf},
 urlsuppl1 = {http://www.nime.org/proceedings/2015/223/0223-file1.mp4},
 year = {2015}
}