PHOTON: Non-Invasive Optical Tracking of Key-Lever Motion in Historical Keyboard Instruments

Noah Jaffe, and John Ashley Burgoyne

Proceedings of the International Conference on New Interfaces for Musical Expression

Abstract

This paper introduces PHOTON (PHysical Optical Tracking of Notes), a non-invasive optical sensing system for measuring key-lever motion in historical keyboard instruments.PHOTON tracks the vertical displacement of the key lever itself, capturing motion shaped by both performer input and the instrument's mechanically imposed, time-varying load.Reflective optical sensors mounted beneath the distal end of each lever provide continuous displacement, timing, and articulation data without interfering with the action.Unlike existing optical systems designed for modern pianos, PHOTON accommodates the diverse geometries, limited clearances, and non-standard layouts of harpsichords, clavichords, and early fortepianos.Its modular, low-profile architecture enables high-resolution, low-latency sensing across multiple manuals and variable key counts.Beyond performance capture, PHOTON provides real-time MIDI output and supports empirical study of expressive gesture, human-instrument interaction, and the construction of instrument-specific MIDI corpora using real historical mechanisms.The complete system is released as open-source hardware and software-from schematics and PCB layouts developed in KiCad to firmware written in CircuitPython-lowering the barrier to adoption, replication, and extension.

Citation

Noah Jaffe, and John Ashley Burgoyne. 2026. PHOTON: Non-Invasive Optical Tracking of Key-Lever Motion in Historical Keyboard Instruments. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.20784256 [PDF]

BibTeX Entry

@inproceedings{nime2026_85,
 abstract = {This paper introduces PHOTON (PHysical Optical Tracking of Notes), a non-invasive optical sensing system for measuring key-lever motion in historical keyboard instruments.PHOTON tracks the vertical displacement of the key lever itself, capturing motion shaped by both performer input and the instrument's mechanically imposed, time-varying load.Reflective optical sensors mounted beneath the distal end of each lever provide continuous displacement, timing, and articulation data without interfering with the action.Unlike existing optical systems designed for modern pianos, PHOTON accommodates the diverse geometries, limited clearances, and non-standard layouts of harpsichords, clavichords, and early fortepianos.Its modular, low-profile architecture enables high-resolution, low-latency sensing across multiple manuals and variable key counts.Beyond performance capture, PHOTON provides real-time MIDI output and supports empirical study of expressive gesture, human-instrument interaction, and the construction of instrument-specific MIDI corpora using real historical mechanisms.The complete system is released as open-source hardware and software-from schematics and PCB layouts developed in KiCad to firmware written in CircuitPython-lowering the barrier to adoption, replication, and extension.},
 address = {London, United Kingdom},
 articleno = {85},
 author = {Noah Jaffe and John Ashley Burgoyne},
 booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
 doi = {10.5281/zenodo.20784256},
 editor = {Benedict Gaster and João Tragtenberg and Anna Xambó and Tom Mitchell},
 issn = {2220-4806},
 month = {June},
 note = {},
 numpages = {8},
 pages = {722--729},
 presentation-video = {https://youtu.be/s9ZEaU9RjfE},
 title = {PHOTON: Non-Invasive Optical Tracking of Key-Lever Motion in Historical Keyboard Instruments},
 track = {Paper},
 url = {http://nime.org/proceedings/2026/nime2026_85.pdf},
 year = {2026}
}