Improving Smartphone Accessibility with Personalizable Static Overlays
André Rodrigues, André Santos, Kyle Montague, Tiago Guerreiro · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17) · doi:10.1145/3132525.3132558
Summary
This paper addresses a fundamental usability problem for blind smartphone users: the loss of interface consistency that occurred when physical keypad phones gave way to touchscreen smartphones. Feature phones had tactually recognizable keys, simpler interfaces, and consistent layouts across applications — combined with a screen reader, they were easily operated by blind people. Smartphones introduced an overwhelming variety of interfaces with no common structure, where even basic elements like confirm buttons appear in different locations both physically and in the navigation hierarchy across different apps. According to WebAim surveys, 20% of screen reader users still used feature phones, and 69% relied on mobile screen readers. The researchers developed PSI (Personalizable Static Interface), an Android accessibility service that superimposes a virtual overlay on top of all applications, splitting the screen into two areas. The Static Area (top half) contains a configurable set of always-available options that function like physical buttons regardless of which app is running — including Navigation Reset, Order (sorting/filtering), Apps, Contacts, Add Favourite, and PSI Settings. The Navigation Area (bottom half) provides standard TalkBack swipe navigation for the current app content, with added ability to sort elements (alphabetically, by frequency, by favourites, or interactive-only) and apply filters on a per-app basis. Users can personalize their templates through easy and expert modes, adding shortcuts for apps, contacts (speed dial), and tasks (predefined action sequences like "open last email").
Key findings
A qualitative lab study with 9 visually impaired participants (ages 27-58, mean 43.3; all legally blind; 4 Android, 5 iPhone users) with smartphone experience ranging from 0.5 to 72 months revealed five themes. All participants successfully completed eight evaluation tasks. Regarding smartphone challenges, participants described deep frustration with inconsistent interfaces — "buttons move from one place to another" — and the lack of spatial awareness when navigating by swipe, likened to "trying to find the metro... circling a post." PSI was valued for bringing structure and consistency: dedicating the top half to static options and the bottom to navigation created clear rules for content access. The ability to sort and order content on demand was seen as promoting discoverability — users could switch between alphabetic ordering and most-used depending on their goal. Participants strongly endorsed PSI for learnability and autonomy, with two expert accessibility instructors suggesting it should be incorporated into TalkBack as an "easy mode" stepping stone. However, concerns included PSI breaking touch-to-explore gestures in the navigation area and halving standard Android gestures, which expert users found limiting. Participants also worried whether sighted helpers could still assist them with PSI running.
Relevance
This research tackles one of the most persistent barriers to smartphone adoption for blind people: the cognitive overhead of learning and remembering how to navigate an ever-changing landscape of app interfaces. While screen readers like TalkBack and VoiceOver provide basic access to content, they do nothing to address the structural inconsistency between apps that makes smartphones bewildering for many blind users. PSI offers a middle path between two extremes — purpose-built accessible phones (which limit functionality and stigmatize) and standard screen readers (which expose full functionality but with inconsistent navigation). The concept of a consistent overlay layer that works across all applications, while still providing access to the full underlying system, is a valuable design pattern for accessibility practitioners. The finding that even experienced blind users struggle with discoverability and navigation after years of use underscores that this is not simply a learning curve problem but a fundamental interface design issue. The suggestion to integrate this as a native "easy mode" in screen readers deserves serious consideration from platform developers.
Tags: blindness · smartphone accessibility · screen readers · mobile accessibility · personalization · interaction design · touchscreen accessibility · TalkBack