Towards LLM-powered Assistive Drone for Blind and Low Vision Users
Yize Wei, Ibnu Taimiyyah Bin Adam, Hanjun Wu, Moritz Messerschmidt, Wei Tsang Ooi, Christophe Jouffrais, Suranga Nanayakkara · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)
Wei and colleagues built and evaluated a voice-based assistive drone prototype for blind and low-vision (BLV) users that leverages GPT-4o in two stages: generating step-by-step Python drone-control code from natural-language commands, and interpreting images captured by the…
blind and low vision · assistive technology · drone · LLM · large language models