Tapulator: A Non-Visual Calculator Using Natural Prefix-Free Codes
Vaspol Ruamviboonsuk, Shiri Azenkot, Richard E. Ladner · 2012 · Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012) · doi:10.1145/2384916.2384963
Summary
This demonstration paper presents the Tapulator, a non-visual calculator for smartphones that replaces traditional on-screen buttons with a simple gesture-based numeric entry system using multi-finger taps and swipes. The core innovation is a natural prefix-free code for entering digits 0-9: a swipe represents 0, one-finger and two-finger taps represent 1 and 2 respectively, and higher digits are composed by combining taps and swipes in short sequences (e.g., digit 3 is a two-finger tap followed by a swipe, representing 2+1=3 in a base-3-like encoding). Because the code is prefix-free — no codeword is a prefix of another — multi-digit numbers can be entered unambiguously without explicit delimiters. The system provides auditory feedback instead of visual feedback, making it usable by blind and low-vision users without requiring them to explore the screen to locate buttons. Arithmetic operations and calculator functions are triggered by additional simple gestures. The approach eliminates the need for the explore-then-activate interaction pattern used by VoiceOver and TalkBack screen readers on standard calculator interfaces.
Key findings
A preliminary evaluation with sighted users compared the Tapulator numeric entry method to a standard accessible numeric keyboard with a VoiceOver-like screen reader interface. Users entered numbers faster and with higher accuracy using the Tapulator method than with the VoiceOver-like interface. The gesture-based approach requires no screen exploration, no button targeting, and no calibration — touches are accepted anywhere on the screen. The encoding scheme is described as natural and easy to learn because it follows an intuitive additive logic. The full Tapulator calculator supports the four arithmetic operations, decimal point, clear, backspace, and equals functions, all through gesture-based input.
Relevance
The Tapulator addresses a real pain point for blind and low-vision smartphone users: numeric entry via screen readers is slow because each digit requires exploring the screen to find the correct button, then double-tapping to activate it. By replacing spatial button layouts with temporal gesture sequences, the Tapulator removes the need for precise screen targeting entirely. For accessibility practitioners, this demonstrates an important design principle: non-visual interfaces should not simply overlay accessibility features onto visual designs (as screen readers do) but can fundamentally rethink the interaction model. The prefix-free code concept could be extended beyond calculators to any numeric entry task on touchscreens, such as entering phone numbers, PINs, or addresses. The limitation is that the study was conducted only with sighted users, so validation with blind users remains needed.
Tags: blindness · low vision · touchscreen accessibility · screen reader · gesture input · mobile accessibility · non-visual interface · VoiceOver