Visually Augmented Audio-Tactile Graphics for Visually Impaired People
Timo Götzelmann · 2018 · ACM Transactions on Accessible Computing (TACCESS) · doi:10.1145/3186894
Summary
This paper presents a novel system for creating visually augmented audio-tactile graphics using 3D printing and standard tablet computers, designed for people with visual impairments including those with residual vision. Traditional tactile graphics (raised-line drawings on swell paper or thermoform) are essential for knowledge transfer to blind learners but suffer from high cognitive load and limited information density. Prior audio-tactile systems that couple physical overlays with electronic feedback typically require expensive specialized hardware (camera systems, custom touch surfaces) or complex calibration. The author's approach uses 3D printed tactile overlays with integrated capacitive markers — conductive structures printed directly into the overlay that register as touch points on a standard capacitive touchscreen. When placed on a tablet, the markers tell the software the exact position and orientation of the overlay, enabling the tablet to provide context-sensitive audio feedback and visual augmentation as the user explores the tactile surface. The key innovation is that the entire overlay, including the conductive markers, can be printed in a single pass on consumer-grade dual-extruder 3D printers using standard PLA filament and conductive PLA filament, with no post-processing required. The system supports multiple elevation levels for graphical elements (unlike flat swell paper), enabling richer tactile differentiation. Two user studies were conducted: the first with 12 visually impaired participants tested the basic audio-tactile map system, and the second with 16 participants (8 blind, 8 low vision) systematically evaluated the effect of visual augmentation across multiple graphic types including maps, bar charts, pie charts, and line diagrams.
Key findings
In the first study, all 12 participants successfully used the 3D printed tactile maps on a standard tablet without prior training, demonstrating the system's learnability. Participants could locate and identify map features (streets, buildings, parks) using combined tactile exploration and audio feedback. In the second study comparing tactile-only, audio-tactile, and visually augmented audio-tactile conditions, visual augmentation provided significant advantages even for participants with very limited residual vision. Participants with low vision completed tasks more quickly and accurately with visual augmentation across all graphic types. The visual augmentation highlighted the currently touched element with high-contrast colours and enlarged labels on the tablet screen, leveraging residual vision to supplement tactile and audio channels. Even participants classified as legally blind but with some light perception benefited from the colour highlighting. Bar charts and pie charts showed the clearest advantages from visual augmentation, while line diagrams — already relatively easy to trace tactilely — showed smaller gains. The capacitive marker system achieved reliable detection: markers were consistently recognized across different tablet devices (iPad, Samsung Galaxy Tab) with position accuracy sufficient for the application. The 3D printing approach reduced production time and cost compared to traditional tactile graphic methods while enabling greater design flexibility.
Relevance
This research demonstrates a practical, low-cost approach to creating multimodal accessible graphics using consumer technology — 3D printers and standard tablets — rather than expensive specialized equipment. For educators and rehabilitation professionals working with visually impaired students, the system offers a way to produce customized tactile learning materials that combine touch, sound, and visual augmentation in a single affordable package. The finding that visual augmentation benefits even people with very limited residual vision is particularly important: the accessibility field sometimes treats blindness as binary, but most people classified as legally blind retain some useful vision that well-designed visual enhancement can leverage. The capacitive marker technique is generalizable beyond maps to any domain requiring tactile-digital coupling — scientific diagrams, mathematical graphs, architectural plans, or data visualizations. For the broader accessibility community, the work exemplifies how combining multiple modalities (tactile, audio, visual) creates richer, more effective information access than any single modality alone.
Tags: tactile graphics · 3D printing · audio-tactile · visual augmentation · low vision · blindness · capacitive markers · tablet computer · tangible interaction · multimodal · maps