Assistive Web Browsing with Touch Interfaces
Faisal Ahmed, Muhammad Asiful Islam, Yevgen Borodin, I. V. Ramakrishnan · 2010 · Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2010) · doi:10.1145/1878803.1878848
Summary
This demo paper from Stony Brook University proposes a touch-based directional navigation technique to improve web browsing for blind users on touch devices (iPhone, MacBook trackpad). The authors identify two key problems with Apple's VoiceOver touch interface: the "fat finger" problem, where a finger covers more than one element at a time (especially on small screens or dense content like tables), making precise selection difficult; and the "finger fatigue" problem, where VoiceOver's swipe interface only supports forward or backward DOM traversal, requiring many consecutive swipes to reach elements that are spatially close on screen but far apart in the DOM tree. For example, navigating down one row in a table requires swiping through every cell in the current row first. The authors propose two algorithmic solutions: first, extending the swipe interface to support directional navigation (up, down, left, right) so users can move to the next element in the swipe direction rather than just forward/backward in the DOM; second, imposing a bound on drag length in the dragging interface, so that when a finger drag exceeds a threshold, focus automatically moves to the next element in the drag direction, preventing accidental skipping of content chunks.
Key findings
A preliminary user study with two blind screen reader users compared the directional navigation system (implemented in the HearSay browser) against Apple's VoiceOver on table navigation tasks using Wikipedia pages. Participants completed tasks at least twice as fast using the directional HearSay system compared to VoiceOver (mean 109.66 seconds vs. 260 seconds per task). On a 5-point Likert scale, participants rated finding information from a particular table cell as more efficient with the directional system (4.5 vs. 2.0). Participants reported experiencing difficulty with VoiceOver due to random skipping of elements (the coarse granularity problem) and strongly agreed that the directional system gave them a better understanding of table layout through the extended swipe and drag interface. The directional approach handles the coarse granularity of touch interaction in a controlled manner by putting a threshold on drag distance, giving users more predictable navigation behavior.
Relevance
This paper addresses fundamental usability challenges with touch-based screen reader navigation that remain relevant today. While VoiceOver and TalkBack have improved significantly since 2010, navigating complex data tables on touch devices is still one of the most challenging tasks for blind users. The core insight — that DOM-order-only navigation is insufficient for spatially organized content — anticipated the later development of rotor controls and table navigation modes in modern screen readers. For accessibility practitioners and web developers, this research reinforces the importance of proper table markup (headers, scope attributes) that enables directional navigation, and highlights that touch interfaces need navigation paradigms beyond simple linear swiping to be truly accessible for complex content structures.
Tags: web accessibility · touch interface · screen reader · VoiceOver · visual impairment · navigation · blind users