HapticRiaMaps: Towards Interactive Exploration of Web World Maps for the Visually Impaired
Nikolaos Kaklanis, Konstantinos Votis, Panagiotis Moschonas, Dimitrios Tzovaras · 2011 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A) · doi:10.1145/1969289.1969316
Summary
This paper presents HapticRiaMaps, a free open-source web application from the Centre for Research and Technology-Hellas (CERTH) in Greece that makes online 2D maps accessible to visually impaired users through haptic force feedback and audio sonification. The system retrieves real-time map data from OpenStreetMap in XML format (nodes, ways, relations, road names, tags), constructs a 2D visual map, then generates a pseudo-3D "grooved line map" where roads become tactile channels that users can feel and follow using haptic devices such as the Sensable Phantom or Novint Falcon. The concept is analogous to a sighted person looking at a tactile map at home — but using virtual rather than physical tactile feedback, with the advantage of accessing any location in the world on demand. Users can search for specific addresses or enter longitude/latitude coordinates, and the map includes rich information points: house numbers, shop names, crossing points, bus stops, and pavement surface types. The system supports zoom in/out for exploring map portions at different scales.
Key findings
The multimodal feedback system uses pitched audio sonifications to convey proximity to crossroads: high pitch for less than 25 meters, medium pitch for 25-50 meters, low pitch for over 50 meters, a unique sound when at a crossroad, and another unique sound when no crossroad is visible in the current direction of movement. Users explore the pseudo-3D map with haptic devices, feeling the grooved road channels while receiving audio cues about their position, distance to points of interest (in meters), and directional information (north, south, east, west, and intermediate directions). The system also provides information through text-to-speech about the current road name and surrounding environment. An initial evaluation with 10 visually impaired users had participants perform route planning tasks and explore unknown environments; feedback was collected for iterative improvement. The four design hypotheses tested were: zoom in/out enables non-static map exploration; haptic representations of spatial data reduce cognitive overload; haptics can guide exploration toward interesting areas; and haptic representations help users notice and remember data relationships better than visual alone. Future work included Google Maps integration (requested by users) and routing guidance between two locations.
Relevance
HapticRiaMaps addresses one of the most significant remaining gaps in web accessibility: maps and spatial information are fundamentally visual, and no amount of alt text or ARIA markup can make a sighted-user map interface meaningfully accessible to a blind person. The grooved-line haptic approach offers genuine spatial understanding rather than just textual descriptions of locations. The use of OpenStreetMap as an open data source was a practical choice that made the system globally applicable without licensing restrictions. The sonification scheme (pitch-coded distance to crossroads) demonstrates how audio can convey continuous spatial variables intuitively. However, the system requires specialized haptic hardware (Phantom or Falcon devices costing hundreds of dollars), limiting real-world adoption. Modern approaches to accessible maps have shifted toward touchscreen gestures with audio feedback (e.g., Apple Maps VoiceOver), which trade haptic fidelity for zero additional hardware cost. The core challenge this paper tackles — giving blind users independent spatial exploration of arbitrary locations — remains highly relevant and incompletely solved.
Tags: blind and low vision · haptic technology · accessible maps · sonification · multimodal interaction · navigation · assistive technology · spatial cognition