Sound, Touch, or the Full Monty? A Comparative Study of Accessible Data Exploration Systems for Blind Users
Pramod Chundury, J. Bern Jordan, Yasmin Reyazuddin, Niklas Elmqvist, Jonathan Lazar · 2026 · ACM Transactions on Accessible Computing · doi:10.1145/3798100
Summary
This paper presents a controlled within-subject comparative study of three accessible data exploration systems representing different sensory modalities: Olli (a screen-reader-based system using hierarchical text descriptions and keyboard navigation), TactualPlot (a tablet-based audio-tactile system where users touch chart elements on a capacitive screen and hear sonified data values), and the Monarch refreshable tactile display (a multi-line pin-based display from HumanWare providing direct tactile access to chart graphics with Braille labels). Ten blind professionals completed data analysis tasks across four chart types — bar charts, pie charts, line charts, and scatterplots — at three levels of complexity: single-point identification, pairwise comparison, and trend/distribution analysis. The study was designed in the tradition of cognitive psychology, with researchers traveling to participants' locations to conduct qualitative interviews and observational assessments in their actual work environments. The authors deliberately frame their findings as device-level comparisons rather than claims about abstract sensory modalities, acknowledging that each system embodies particular hardware constraints, interaction techniques, and feedback mappings that shape the user experience. Olli generates a four-level hierarchical text description (summary, encodings, intervals/categories, data points) navigable by arrow keys, parsing chart specifications from D3, Chart.js, or Vega-Lite. TactualPlot was extended from its original scatterplot-only focus to support all four chart types, using MIDI-based sonification through the Web Audio API with 100 distinct pitch levels, spatial audio panning, and different audio instruments for multiple data series. The Monarch renders static tactile visualizations using different shapes for categorical encoding (circles, squares, triangles for scatterplots; different line stroke patterns for line charts) with Braille text labels.
Key findings
Task accuracy did not differ significantly across the three systems, demonstrating that blind users can effectively analyze data through sound, touch, or text descriptions. However, completion time varied substantially — participants were fastest on the Monarch refreshable tactile display, particularly for tasks requiring spatial understanding like trend identification in line charts and distribution analysis in scatterplots. NASA-TLX workload ratings revealed significant differences in mental demand, effort, and temporal demand across systems. Qualitative findings through think-aloud protocols illuminated how device-specific interaction techniques shaped user strategies: Olli users followed a systematic hierarchical drill-down approach (overview first, details on demand) but found it difficult to build spatial mental models of data; TactualPlot users could explore spatially by dragging fingers across the touchscreen while hearing continuous sonification, enabling intuitive trend detection but requiring practice to interpret pitch mappings precisely; Monarch users could simultaneously feel the spatial layout and read Braille labels, providing the most immediate spatial understanding but facing challenges with display resolution and cluttered visualizations. Line charts and scatterplots proved most challenging across all systems due to their reliance on spatial relationships that are difficult to convey through text alone. The paper contributes design implications including the value of combining modalities (no single modality excelled at all tasks), the importance of enabling both overview and detail access, and the need for consistent interaction patterns across chart types.
Relevance
This is one of the first rigorous empirical comparisons of fundamentally different approaches to accessible data visualization — text/audio (Olli), audio-tactile hybrid (TactualPlot), and pure tactile (Monarch) — tested with blind professionals on realistic data analysis tasks. The study is timely as data literacy becomes increasingly essential in professional settings, and blind workers face growing barriers accessing data visualizations that pervade modern workplaces. The finding that no single modality dominates across all tasks strongly argues for multimodal approaches that combine the strengths of each: text for precise values and summaries, sonification for trends and continuous data, and tactile for spatial layouts and distribution patterns. For practitioners building accessible data visualizations, the hierarchical description approach used by Olli — which follows the "overview first, details on demand" information visualization mantra — provides a practical, implementable pattern for screen reader accessibility of charts. The paper also highlights the growing importance of refreshable tactile displays like the Monarch as they become more widely available, and the potential of the Web Audio API for building sonification-based accessibility tools directly in web browsers.
Tags: data visualization · sonification · tactile graphics · refreshable braille display · multimodal accessibility · blind users · screen readers · user study · data accessibility
Standards referenced: Web Audio API