TouchScribe: Augmenting Non-Visual Hand-Object Interactions with Automated Live Visual Descriptions
Ruei-Che Chang, Rosiana Natalie, Wenqian Xu, Jovan Zheng Feng Yap, Tiange Luo, Venkatesh Potluri, Anhong Guo · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)
TouchScribe is a wearable, camera-based assistive system that delivers live, hierarchical visual descriptions of physical objects in response to a blind or low vision (BLV) user's hand-object interactions. The authors argue that existing AI assistants such as Seeing AI, Be My…
blind and low vision · assistive technology · visual descriptions · hand-object interactions · gestures