Principles for Designing Large-Format Refreshable Haptic Graphics Using Touchscreen Devices: An Evaluation of Nonvisual Panning Methods
Hari Prasath Palani, Nicholas A. Giudice · 2017 · ACM Transactions on Accessible Computing · doi:10.1145/3035537
Summary
This paper addresses a fundamental challenge in touchscreen-based accessibility: how to provide non-visual access to large-format graphical materials like maps that exceed the device's screen size. While touchscreens represent the fastest-growing computing platform among people with blindness, their limited screen real estate creates a problem that visual users solve through panning and zooming—operations that cannot be directly transferred to non-visual interfaces due to both perceptual constraints (touch has a restricted field of view compared to vision) and cognitive constraints (users lose their reference point after panning, causing disorientation). The authors developed four novel non-visual panning methods based on key design principles: (1) Two-Finger Drag—placing a second finger anywhere initiates panning mode; dragging both fingers moves the map while keeping content under the primary finger constant; (2) Button-Touch—user lifts finger, presses a button, and places finger at new location where previous position now appears; (3) Button-Drag—pressing volume button enables pan mode for dragging with primary finger; (4) Grid-Tap—double-tapping screen edges moves content one grid cell at a time. All methods were implemented using a Vibro-Audio Interface (VAI) that provides vibrotactile feedback and spoken labels when touching graphical elements on the touchscreen.
Key findings
Two experiments evaluated these panning methods against a non-panning control condition using indoor corridor maps. Experiment 1 involved 15 blindfolded sighted participants; Experiment 2 involved 6 blind participants (ages 18-43). The critical finding was that exploration, learning, and subsequent spatial behaviors were remarkably similar between panning and non-panning conditions across eight measures including learning time, directional accuracy, map reconstruction accuracy, and landmark positioning. This demonstrates that users successfully integrated graphical elements across multiple panned screens into accurate cognitive maps. The two-finger drag method emerged as best overall: it had learning times equivalent to the control condition (despite requiring panning operations), required fewer map traversals indicating more intuitive use, and was most preferred by both participant groups. Interestingly, subjective preferences did not correlate with performance—participants preferred the non-panning control but performed better with two-finger drag. Between-groups analysis found no significant differences between blind and blindfolded-sighted participants, validating the use of blindfolded participants in preliminary accessibility studies and confirming that the ability to learn graphical information through touch is similar regardless of vision status.
Relevance
This research provides concrete design principles for touchscreen-based non-visual interfaces. The core insight is that non-visual panning must maintain a stable reference point under the user's exploring finger—methods that required lifting the finger (button-touch, grid-tap) performed worse than those keeping continuous contact (two-finger drag, button-drag). Additional guidelines include: use multiple fingers or buttons to differentiate exploration from panning gestures; keep panning simple rather than a process requiring learning; consider device aspect ratio (vertical alignment was easier than horizontal); add boundary feedback when content extends beyond screen edges; and implement "snap back" functionality for disoriented users. For practitioners developing accessible map or graphics applications, these findings validate that panning is viable and necessary for touchscreen accessibility—without it, large-format graphics would remain inaccessible on the devices most widely adopted by blind users. The two-finger drag technique is recommended as the default implementation.
Tags: tactile graphics · blindness · touchscreen accessibility · haptic feedback · spatial cognition · non-visual maps · multimodal interaction