GuideMe: A VLM-Based System Assisting Independent Smartphone Learning for Older Adults
Kairong Fang, Jiesi Zhang, Shi-Ting Ni, Pan Hui, Yuyang Wang · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)
GuideMe tackles a problem familiar to anyone who has watched an older relative struggle to learn a new smartphone app: the combined weight of declining vision, memory, and motor function plus unfamiliar terminology makes independent learning extremely difficult, while in-person…
older adults · aging · cognitive accessibility · vision-language model · conversational agent