Toward Independent Online Shopping of the Visually Impaired Through Voice-based Computer-Using Agent
Subin Shin, Jeesun Oh, Suhyun Kim, Seoyeon Eom, Sangwon Lee · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)
This CHI 2026 paper investigates how visually impaired users might shop online independently by interacting with a voice-based Computer-Using Agent (CUA) — an AI agent built on a Large Multimodal Model (LMM) that can perceive a screen, reason about its contents, and manipulate a…
visual impairment · blindness · low vision · voice interface · conversational user interfaces