Design and Implementation of Virtual Environments for Training of the Visually Impaired
D. Tzovaras, G. Nikolakis, G. Fergadis, S. Malasiotis, M. Stavrakis · 2002 · Proceedings of the Fifth International ACM Conference on Assistive Technologies (Assets '02) · doi:10.1145/638249.638259
Summary
This paper from the Informatics and Telematics Institute in Greece presents the ENORASI project, an EU-funded initiative to develop a haptic virtual reality training system for blind and visually impaired people. The system uses a CyberGrasp haptic glove — an exoskeletal device worn on the hand that applies force feedback to individual fingers — to allow users to "feel" and interact with virtual 3D objects through touch. The key challenge is representing visual information through haptic and auditory channels without any visual display. The ENORASI prototype includes an authoring environment for creating virtual scenes using VRML-format 3D objects, a collision detection system (using the PQP algorithm optimised for haptic interaction) that determines when virtual fingers contact virtual objects, and customisable force feedback parameters including grasping force, stiffness, and damping properties. Two main application types were developed: desk-based tasks (object recognition, map navigation, mathematics, target shooting, object squeezing) and cane simulation tasks (indoor/outdoor navigation). The cane simulation is particularly innovative — the user's index finger becomes a virtual cane extension, with force applied to the finger when the cane collides with objects, floors, or walls, and different force patterns (constant force for grasping, cosine buzzing for penetrating objects, jolt effects for impacts) simulating realistic cane feedback.
Key findings
Feasibility testing with 26 blind participants (representing congenitally blind, late blind, adults, and children) across eight test categories showed remarkably positive results. Success rates ranged from 96% to 100% across all tests, and 90-100% of users characterised each test as useful or very useful. Users faced no general usability difficulties with the pilot system and required little to no guidance after initial familiarisation. Specific findings include: users could recognise geometric shapes and reconstruct their spatial arrangement through touch alone (Test 1); users could estimate relative sizes and manipulate objects in virtual space (Test 2); users could explore and navigate virtual floor plans, counting rooms and finding specific rooms by following walls and identifying door openings through haptic ridges (Test 3); users could feel and plot sinusoidal mathematical curves through force applied to their fingertips (Test 4); users could distinguish virtual ball stiffness properties corresponding to real balls with different inflation levels (Test 5); and 3D spatial sound was demonstrated as an effective positioning and orientation cue for target shooting and navigation tasks (Tests 6-7). Participants identified the most important application areas as mobility and orientation training, shape recognition, mathematics, simulating athletic events, and map/cane simulation.
Relevance
This research demonstrated the feasibility of using haptic virtual reality as a training tool for blind people, addressing several important needs. For orientation and mobility training, virtual cane simulation offers a safe environment to practice navigation without real-world hazards — users can explore virtual buildings, cross virtual streets, and learn spatial layouts before encountering them physically. For education, haptic access to mathematical graphs, geometric shapes, and spatial relationships provides blind students with experiences that are typically available only through static tactile graphics. The force feedback approach to conveying object properties (shape, size, stiffness, texture) through the CyberGrasp glove was more nuanced than simple vibrotactile feedback, allowing users to distinguish fine physical differences. The combination of haptic and 3D audio feedback created a multimodal virtual environment that was intuitive enough for users to navigate without guidance. While the CyberGrasp hardware was expensive and tethered, the research validated the concept of haptic VR training and influenced subsequent work on more accessible haptic interfaces for blind users.
Tags: haptic technology · virtual reality · blindness and low vision · training · orientation and mobility · spatial cognition · force feedback · spatial audio · accessible graphics