The Audio Abacus: Representing Numerical Values with Nonspeech Sound for the Visually Impaired
Bruce N. Walker, Jeffrey Lindsay, Justin Godfrey · 2003 · Proceedings of the 6th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '04) · doi:10.1145/1028630.1028634
Summary
This paper introduces the Audio Abacus, a novel sonification application that transforms exact numerical values into sequences of non-speech tones, following the analogy of a physical abacus where each digit is represented by a distinct sound. Unlike most sonification research, which focuses on trend analysis (detecting patterns across data series), this work addresses point estimation — the task of determining a specific exact value at a particular point in time. The authors argue that point estimation is critically underserved by existing auditory displays, yet is essential for everyday tasks such as checking prices at a grocery store, reading stock values, or verifying numerical data. The Audio Abacus maps each digit (0-9) to a MIDI pitch, with higher digits producing higher tones. Numbers are played as sequences of tones from left to right, with each digit position (hundreds, tens, ones, tenths, hundredths) played sequentially and a cymbal crash marking the decimal point. The system offers extensive configurability: adjustable pitch range (minimum and maximum MIDI notes), spatial panning (digits can be spatially positioned left-to-right in the listener's sound image), multiple playback orderings (single pass, double pass, bounce pass), adjustable time ratios between digit positions, and selectable MIDI instruments. The software is written in Java for cross-platform portability.
Key findings
Thirty sighted undergraduate participants (21 female, 9 male, mean age 19.6) were tested on their ability to identify stock prices sonified by the Audio Abacus, with minimal training (a brief learning phase covering single digits, simple numbers, and decimals). The study used piano tones with a pitch range of MIDI notes 40-90, single pass left-to-right playback, and equal time ratios across digits. Unsuccessful responses (where participants identified the wrong number of digits) accounted for only about 10% of all trials, indicating that users could reliably determine the structure of sonified numbers. Among successful responses, 80% of participants' digit estimates were within two of the actual value, and 90% were within three. Performance was consistent across digit positions (thousands, hundreds, tens, ones, tenths, hundredths), suggesting that the mapping scales effectively regardless of the number's magnitude. These results were achieved with very little training and using only the most basic configuration settings, suggesting substantial room for improvement through optimised pitch ranges, spatial panning, variable time ratios, and practice effects.
Relevance
This paper addresses a gap in accessible information design that persists today: while trend sonification has received significant research attention, the precise communication of exact numerical values through sound remains largely unsolved in practical applications. Visually impaired people routinely encounter numerical data — prices, temperatures, measurements, financial figures — that screen readers handle by simply reading digits aloud, a serial process that is slow and places heavy demands on working memory. The Audio Abacus offers a parallel alternative where the pitch and spatial position of tones convey digit values and positions simultaneously, potentially enabling faster numerical comprehension. The finding that untrained users could identify digits within two of the correct value with basic settings is promising, though the study's limitation to sighted participants means the approach needs validation with blind and visually impaired users, who may have enhanced auditory discrimination skills. For practitioners designing accessible data interfaces, this work demonstrates that non-speech sound can go beyond simple alerts and trend indicators to convey precise quantitative information — a capability particularly relevant for accessible scientific software, financial tools, and educational applications.
Tags: sonification · auditory display · blindness and low vision · data visualization · non-visual interaction · mathematical accessibility · MIDI · spatial audio