Usability of a Multimodal Video Game to Improve Navigation Skills for Blind Children
Jaime Sánchez, Mauricio Saenz, Jose Miguel Garrido · 2010 · ACM Transactions on Accessible Computing · doi:10.1145/1857920.1857924
Summary
This paper presents an evaluative study of a multimodal system combining a custom haptic device (Digital Clock Carpet) with a 3D audio-based video game (MOVA3D) to develop orientation and mobility (O&M) skills in blind school-aged children. The Digital Clock Carpet is a low-cost wooden platform with 12 tactile cells arranged like clock hours, allowing children to indicate directions using their feet—12 o'clock means forward, 3 o'clock means right, and so on. This "clock system" metaphor provides an intuitive way to communicate navigation directions without requiring prior knowledge of the system. The MOVA3D video game uses spatial audio to create virtual representations of real buildings from three Chilean cities, where children navigate to find hidden objects while avoiding enemies. The system was designed following a user-centered methodology, incorporating children aged 6-12 from the earliest design stages. Three usability evaluations were conducted: a heuristic evaluation with 5 experts, an initial usability evaluation with 20 blind children that led to iterative redesigns, and a final end-user usability evaluation with 19 children. A separate cognitive evaluation assessed O&M skill development with 24 children over three months.
Key findings
The usability evaluations showed high acceptance: the end-user evaluation achieved scores above 9.0/10 across all dimensions (Satisfaction: 9.20, Sounds: 9.20, Control & Use: 9.00). Importantly, no significant differences were found between totally blind and low-vision users, indicating the system works well for both groups. The O&M evaluation revealed statistically significant improvements in Tempo-Spatial Orientation skills for both age groups: children aged 7-9 improved from 68.04 to 83.15 (p=0.01), and children aged 10-14 improved from 64.88 to 78.91 (p=0.004). In navigation tasks, 91.6% of participants successfully completed virtual navigation tasks, and critically, 83.3% successfully transferred these skills to navigate the real-world spaces that had been modeled in the game—demonstrating that virtual training can translate to real-world O&M competence. Children developed mental maps of environments through gameplay, counting steps and learning room distributions, then applied these strategies when physically navigating the actual buildings.
Relevance
This research demonstrates that carefully designed multimodal interfaces combining audio and haptics can effectively teach real-world navigation skills to blind children. The clock system metaphor for directions is particularly elegant—it leverages familiar knowledge and allows full-body interaction rather than hand-only input, making the connection between virtual and physical movement more intuitive. For accessibility practitioners, this work shows the value of iterative, user-centered design with end users from the start: the heuristic evaluation identified spatial sound issues, and the initial usability evaluation led to significant device redesigns (adding carpet texture, improving visual contrast for low-vision users). The successful transfer from virtual to real navigation suggests that audio-based virtual environments can serve as safe, controlled training grounds for O&M skills development—children can practice navigation without physical risk before applying skills in unfamiliar real spaces.
Tags: blindness · orientation and mobility · haptic interface · audio games · spatial cognition · children · virtual environments · multimodal interaction