Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques
Shaun K. Kane, Jeffrey P. Bigham, Jacob O. Wobbrock · 2008 · Assets '08: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/1414471.1414487
Summary
This paper introduces Slide Rule, a set of audio-based multi-touch interaction techniques that make touch screen devices accessible to blind users without requiring any additional hardware. Published in 2008 — just one year after the iPhone launched and before VoiceOver was added to iOS — the paper addresses the fundamental problem that touch screens require users to visually locate on-screen objects, making them largely inaccessible to blind people. The research began with formative interviews with 8 blind mobile device users, which revealed that all carried an average of 3.6 devices, most had rarely used touch screens, and those who had encountered them used workarounds like memorizing button locations or adding tactile markers. Three key design implications emerged: users favored familiar spatial layouts, wanted to consolidate multiple devices into one, and needed interfaces that were safe to explore without accidental activation. Slide Rule uses four core gestures: a one-finger scan (sliding a finger down the screen to hear items read aloud), a second-finger tap (holding one finger on an item and tapping anywhere with another finger to select it), multi-directional flicks (for navigation actions like forwarding email or changing pages), and an L-select gesture (scanning down the left edge then right to browse hierarchical data like artist-to-song). The interface is entirely speech-based with no visual feedback, laying out items in dense single-column lists that users explore by touch. Three prototype applications were built on an iPhone: Phone (contacts), Mail (email), and Music (player).
Key findings
In a controlled evaluation with 10 blind participants comparing Slide Rule on an iPhone to equivalent applications on an ASUS Pocket PC running Mobile Speak Pocket (a button-based screen reader), Slide Rule was significantly faster overall — mean task completion time of 11.69 seconds versus 12.79 seconds for the Pocket PC (F(1,9)=5.68, p<0.05). Slide Rule was the faster technique for 6 of 10 participants. Listening time per item was also significantly faster with Slide Rule (0.95 seconds vs. 1.42 seconds, F(1,8)=68.88, p<0.001), indicating that the scan gesture allowed quicker browsing than sequential button presses. However, Slide Rule produced significantly more errors — an average of 0.20 errors per trial versus zero for the Pocket PC (z=-3.80, p<0.001), with 14.1% of Slide Rule trials containing at least one error. Despite this speed-accuracy tradeoff, 7 of 10 participants preferred Slide Rule over the Pocket PC. Participants found Slide Rule more "natural" and enjoyed the direct manipulation of touch, with one stating "I've never seen a touch screen that accessible before, and that was pretty cool." Questionnaire results showed the Pocket PC rated significantly higher on ease of use, feeling in control, easy to learn, and familiarity (all p<0.05), yet participants still preferred the novel touch-based system. Some participants expressed skepticism that touch screens could ever work for blind users — "Flat screens without a grid — a real tangible grid — are difficult for blind people" — reflecting the prevailing assumption of the time that Slide Rule helped challenge.
Relevance
Slide Rule is a landmark paper in mobile accessibility, published at a pivotal moment when the smartphone revolution was beginning but before any major platform had implemented touch screen accessibility. The interaction paradigms it introduced — particularly the explore-by-touch gesture (scanning with one finger to hear items) and the split-tap selection (holding one finger on an item and tapping with another) — directly influenced the design of VoiceOver on iOS, which Apple introduced for iPhone in 2009 and which uses strikingly similar patterns. The paper demonstrated that touch screens could not only be made accessible to blind users but could actually be faster than traditional button-based alternatives, overturning the widespread assumption that flat glass screens were inherently inaccessible. For accessibility practitioners, the design principles remain highly relevant: risk-free exploration (touching should never trigger destructive actions), operating at finger resolution rather than screen resolution, reducing demand for selection accuracy, and using intuitive gestural mappings. The speed-accuracy tradeoff finding is also instructive — users preferred the faster, less accurate system, suggesting that speed and naturalness of interaction may matter more to users than error-free operation, especially when errors have low cost. This paper is essential reading for understanding how modern mobile accessibility came to be.
Tags: blind users · touch screens · mobile accessibility · multi-touch interaction · gestures · screen readers · assistive technology · eyes-free interaction