"Composability": Widening Participation in Music Making for People with Disabilities via Music Software and Controller Solutions
Tim Anderson, Clare Smith · 1996 · Proceedings of the Second Annual ACM Conference on Assistive Technologies (Assets '96) · doi:10.1145/228347.228365
Summary
This paper from the Drake Music Project and University of York discusses enabling visually impaired and physically disabled people to compose and perform music through adapted software and controller solutions. The Drake Music Project (DMP), a UK charity founded in 1988, facilitates music-making for physically disabled people through technology, running workshops that teach music via group and individual sessions using adapted equipment. The paper examines two approaches: adapting existing commercial music software (like Steinberg Cubase) for disabled users, and developing a custom system called E-Scape designed from the ground up for accessibility. For physical disabilities, adaptations to standard software include switch-controlled menu overlays, MIDI controller adaptations (using joysticks, single switches, or head pointers instead of keyboards), screen magnification for users with partial visual impairment, and reduction in the number of actions required. For visual impairments, standard screen readers and magnifiers are used but face significant limitations because music notation is inherently graphical. The paper documents the practical problems encountered, including that screen readers cannot interpret graphical score displays, mouse-based operations are inaccessible to switch users, and commercial software requires too many precise movements.
Key findings
The custom E-Scape system addresses these barriers through several design principles. It provides control through flexible input pathways: keyboard, mouse, MIDI controller, external switch, or combinations — all producing the same control events. Single switch mode with scanning is supported, where each menu item plays itself auditorily when highlighted. The system structures composition into guided "Activities" (like Note Entry, Transposition) that break complex tasks into manageable sequential steps, reducing the cognitive and motor demands. E-Scape reduces effort by offering appropriately restricted option sets rather than overwhelming users with all possibilities. For visually impaired users, E-Scape provides auditory feedback at each stage and a score display with user-adjustable colours, fonts, and magnification. A comparison of the same note-entry task in Cubase versus E-Scape showed that while Cubase requires multiple complex mouse operations (click and drag, hold buttons, navigate dense graphical displays), E-Scape guides the user through sequential menu choices with immediate auditory confirmation. The paper also identifies E-Scape's educational potential — it can structure activities to guide students through compositional processes with varying degrees of creative freedom, from beginner-level activities with few choices to advanced open-ended composition.
Relevance
This paper highlights the enduring challenge of making creative software accessible — music composition tools remain largely visual and mouse-dependent today. The core design principles identified are broadly applicable beyond music: providing multiple input pathways to the same functionality, structuring complex tasks into guided sequential steps, offering appropriately constrained option sets to reduce cognitive load, and ensuring continuous non-visual feedback. The distinction between adapting existing mainstream software (which often hits fundamental accessibility limits) versus building purpose-designed accessible tools remains a central tension in assistive technology. For accessibility practitioners, the paper demonstrates that accessibility in creative domains requires more than just making existing interfaces operable — it requires rethinking the interaction model to match the capabilities and needs of users with disabilities. The DMP's educational approach of progressively increasing creative freedom as users gain confidence offers a model for scaffolded learning in any accessible software context.
Tags: music accessibility · creative arts · MIDI · adaptive technology · physical disability · visual impairment · education · switch access · inclusive design
Standards referenced: MIDI