From the Lab to People's Home: Lessons from Accessing Blind Participants' Interactions via Smart Glasses in Remote Studies
Kyungjun Lee, Jonggi Hong, Ebrima Jarjue, Ernest Essuah Mensah, Hernisa Kacorri · 2022 · Proceedings of the 19th International Web for All Conference (W4A) · doi:10.1145/3493612.3520448
Summary
This paper from the University of Maryland explores using smart glasses as an observational tool in remote usability studies with blind participants. The COVID-19 pandemic forced accessibility researchers to shift from in-person to remote methods, but standard remote setups — typically a laptop camera facing the participant — provide limited visibility of how blind participants interact with smartphone testbeds and physical objects. The researchers devised a dual video conferencing approach: participants wore Vuzix Blade smart glasses that streamed a first-person view to the experimenter via Zoom, while a laptop camera provided the traditional third-person view. The team went through four iterative pilot sessions with both sighted and blind researchers to refine the protocol before deploying it in a case study with 12 blind participants (8 totally blind, 4 legally blind, ages 33-70) in their homes. Participants received shipped study materials including an iPhone with testbed apps, a MacBook, smart glasses pre-configured with Zoom, and a portable WiFi hotspot. The study tasks involved using smartphone apps for object recognition, requiring participants to handle physical objects, take photos, and interact with on-screen interfaces — activities particularly difficult to observe remotely.
Key findings
Smart glasses dramatically outperformed laptop cameras for capturing participant interactions: on average 58.7% of interactions were fully visible via the first-person smart glasses view compared to only 3.7% via the third-person laptop camera. However, this gain was not uniform across participants. A critical finding relates to head orientation differences between congenitally blind and late-blind participants. Those who became blind later in life tended to aim their gaze (and thus the camera) toward the mobile device, yielding higher visibility (up to 96.86% for one participant). Congenitally blind participants often oriented their ear toward the sound source (the screen reader audio), directing the camera away from the device and yielding as low as 19.83% visibility. This highlights a fundamental design challenge: smart glasses with narrow fields of view (64 degrees on Vuzix Blade) may systematically exclude congenitally blind users. The study also uncovered significant practical challenges: no commercially available smart glasses support screen readers, battery life was limited to 30-40 minutes for video streaming, earbuds conflicted with hearing both the study device and experimenter, WiFi connectivity in participants' homes was unreliable, and hardware troubleshooting often required a nearby experimenter to handle cable disconnections and other issues that blind participants could not easily diagnose.
Relevance
This research provides invaluable practical guidance for accessibility researchers conducting remote studies with blind participants — a methodology that became essential during COVID-19 and remains important for improving participant diversity and reducing travel barriers. The smart glasses approach offers a meaningful improvement over standard webcam setups, but the paper is refreshingly honest about limitations, providing a realistic assessment rather than an idealized picture. The finding about head orientation differences between congenitally and late-blind participants has implications beyond research methodology — it affects the design of any head-mounted assistive technology, from smart glasses to augmented reality devices. The paper also highlights a concerning gap: smart glasses, including those marketed for accessibility use cases, lack basic screen reader support, making them inaccessible to their intended users. For research teams, the detailed lessons about equipment delivery, network reliability, troubleshooting logistics, and the recommendation to have at least two experimenters (one remote, one local) provide a practical playbook for conducting inclusive remote studies.
Tags: blindness and low vision · smart glasses · remote usability testing · user research · assistive technology · wearable technology · research methods