The Flote: An Instrument for People with Limited Mobility
Amal Dar Aziz, Chris Warren, Hayden Bursk, Sean Follmer · 2008 · Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '08) · doi:10.1145/1414471.1414545
Summary
This paper introduces the Flote, a digital wind instrument designed to enable people with limited mobility to play music using only head movement and breath control. Developed at Stanford University through a collaboration between computer science and music departments (CCRMA), the Flote addresses a gap in accessible musical instruments: previous projects like Hyperscore and the Deep Listening Institute's Adaptive Use tools either lacked the real-time expressiveness of a traditional instrument or required expensive proprietary hardware. The Flote's hardware consists of an adapted headset with a boom microphone and infrared emitting diodes (IREDs) mounted on the boom arm, tracked by a standard webcam. The player blows into the microphone to produce notes (harder breath means louder sound), while tilting their head up and down changes pitch. A visible light filter made from developed, unexposed slide film allows the webcam to isolate the IRED for reliable motion tracking. The entire hardware setup uses readily available, inexpensive components that anyone with minimal electronics experience can assemble.
Key findings
The Flote achieves musical expressiveness through two key calibration systems. Breath sensitivity is calibrated per user through a low-pass filter at 5 Hz that retains breath pressure data while eliminating false triggers from external sounds. Head tracking is customized per player, allowing users to define their comfortable range of movement on either a vertical or horizontal axis, which is then mapped to the full scale of playable notes — meaning individuals with very limited range of motion can still access all notes. The software offers two performance modes: an unlocked mode where head position directly controls pitch, and a locked mode where pitch is fixed once a note begins, freeing the player to reposition for the next note. User testing with individuals who had little or no musical training showed promising results — participants intuitively approached the instrument by moving their heads and reacting to sounds produced, progressing to remembering and responding to written musical notes. Several users expressed interest in composing music, and the Flote showed potential as a tool for learning to read sheet music.
Relevance
The Flote demonstrates important principles for accessible assistive technology design: calibration to individual abilities, use of low-cost readily available components, and open-source software distribution. For accessibility practitioners, it illustrates how creative expression — often overlooked in favor of functional communication and daily living tools — is a legitimate and important area for assistive technology. The project's emphasis on building something anyone can assemble with online instructions and free software reflects a DIY/maker approach to assistive technology that has become increasingly influential. The dual-input approach (breath plus head movement) also provides a model for how limited motor capabilities can be mapped to rich, expressive interactions through thoughtful calibration and interface design.
Tags: music accessibility · adaptive musical instrument · limited mobility · head tracking · breath control · assistive technology · creative expression · physical therapy · DIY assistive technology