Exploration and Avoidance of Surrounding Obstacles for the Visually Impaired
Limin Zeng, Denise Prescher, Gerhard Weber · 2012 · Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012) · doi:10.1145/2384916.2384936
Summary
This paper presents the 3DOD (3D Obstacle Detector), a wearable system that combines a 3D Time-of-Flight (TOF) camera with a portable multi-line refreshable Braille display to help blind pedestrians detect and avoid obstacles beyond the reach of a white cane. White canes detect floor-level obstacles within about one metre but cannot sense head-height hazards like hanging signs, low branches, or overhead obstacles, and provide no spatial overview of the environment. The 3DOD system addresses these limitations by mounting a TOF camera at waist height to capture depth data up to 7 metres ahead, then processing the 3D point cloud using a density-based spatial clustering algorithm to identify individual obstacles and their properties (type, distance, direction, width, and height). These obstacles are rendered as abstract tactile symbols on a 30x32 pin Braille display held in the user's hand, with a central reference grid showing the user's position and surrounding space up to 4 metres. The system also includes a Wii remote controller integrated into an enhanced white cane, which provides vibrotactile warnings when obstacles are within 2 metres and allows switching between two modes: walking mode (continuous monitoring with vibration alerts) and inspection mode (static snapshot for detailed exploration of the obstacle layout on the Braille display).
Key findings
A user study with 6 legally blind participants evaluated the system through training, pre-tests, and real-world navigation trials in a large lecture hall containing 12 obstacles (chairs, tables, hanging boards, balloons, poles, and boxes). Participants learned the tactile obstacle symbols in approximately 3 minutes and identified obstacle properties with 87.8% accuracy. In the pre-test, all participants successfully located a box on the floor using the Braille display, reporting its direction using a clock-face orientation system with reasonable accuracy (mean: 11 o'clock vs actual 11 o'clock position). In the real navigation trials, participants using 3DOD needed significantly fewer decision points per route (mean 2.50 vs 4.83 with cane alone, p=0.017) and chose wider, more deliberate detour paths rather than the narrow paths taken with canes. Critically, participants using white canes alone hit all hanging obstacles with their bodies, while 3DOD users avoided them entirely in most cases (0 hanging obstacle hits for 3 of 4 3DOD trials). However, 3DOD users took substantially longer to complete routes (1-2.5 minutes vs 19-43 seconds with cane) due to the need to stop and read the tactile display. Post-questionnaire ratings were high across all 8 questions (mean 3.7 to 4.7 out of 5), with participants especially valuing the obstacle distribution overview (4.7) and vibration warnings (4.7).
Relevance
This research addresses a critical safety gap in blind mobility: the inability of white canes to detect head-height and overhanging obstacles, which cause some of the most dangerous accidents for blind pedestrians. The use of a refreshable Braille display to convey spatial obstacle layouts is a novel approach that provides richer environmental information than audio or simple vibrotactile cues. For accessibility practitioners and assistive technology developers, the tactile symbol system for encoding obstacle type, width, and height offers a reusable design vocabulary for non-visual spatial communication. The main practical limitation — the significant time cost of stopping to read the display — highlights the ongoing tension in assistive navigation between safety and speed. The study demonstrates that even with relatively bulky prototype hardware (1kg camera, 600g display, portable computer), blind users could successfully plan safer routes, suggesting that miniaturized future versions could be practically viable for daily use.
Tags: blindness · obstacle detection · electronic travel aid · haptic feedback · tactile display · refreshable braille display · wayfinding · mobility · depth sensing · assistive technology