Reviews

Search results

• CheerBrush: A Novel Interactive Augmented Reality Coaching System for Toothbrushing Skills in Children with Autism Spectrum Disorder

  Z. Kevin Zheng, Nandan Sarkar, Amy Swanson, Amy Weitlauf, Zachary Warren, Nilanjan Sarkar · 2021 · ACM Transactions on Accessible Computing

  CheerBrush is an augmented reality system designed to teach toothbrushing skills to children with autism spectrum disorder (ASD). Many children with ASD struggle with toothbrushing due to differences in motor dexterity, learning styles, and sensory sensitivity—leading to poor…

  autism spectrum disorder · augmented reality · daily living skills · children · motor skills

• Making Mobile Augmented Reality Applications Accessible

  Jaylin Herskovitz, Jason Wu, Samuel White, Amy Pavel, Gabriel Reyes, Anhong Guo, Jeffrey P. Bigham · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This paper tackles a fundamental accessibility gap in augmented reality: AR applications are overwhelmingly visual, mixing virtual 3D objects with the real world in ways that existing screen readers and accessibility services cannot interpret. The researchers analyzed 105…

  augmented reality · visual accessibility · blindness and low vision · mobile accessibility · screen readers

• AIGuide: An Augmented Reality Hand Guidance Application for People with Visual Impairments

  Nelson Daniel Troncoso Aldas, Sooyeon Lee, Chonghan Lee, Mary Beth Rosson, John M. Carroll, Vijaykrishnan Narayanan · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This paper presents AIGuide, a self-contained offline iOS smartphone application that uses augmented reality (ARKit) to help people with visual impairments locate, navigate to, and pick up objects in their surroundings. Unlike existing object detection apps (Seeing AI, Aipoly)…

  visual accessibility · augmented reality · blindness and low vision · mobile accessibility · computer vision

• Chat in the Hat: A Portable Interpreter for Sign Language Users

  Larwan Berke, William Thies, Danielle Bragg · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper addresses a fundamental limitation of Video Remote Interpreting (VRI) for Deaf and Hard-of-Hearing (DHH) sign language users: existing smartphone-based VRI requires the DHH person to either hold the phone with one hand (reducing signing to one-handed and causing…

  deaf and hard of hearing · sign language · video remote interpreting · augmented reality · workplace accessibility

• Supporting Selfie Editing Experiences for People with Visual Impairments

  Soobin Park · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This short paper investigates the selfie editing experiences and desires of people with visual impairments (PVI), a topic largely overlooked despite research showing that PVI actively participate in social media and photo sharing. The study has two parts: an online survey of 47…

  visual impairment · social media accessibility · photo editing · voice interface · blindness

• ReCog: Supporting Blind People in Recognizing Personal Objects

  Dragan Ahmetovic, Daisuke Sato, Uran Oh, Tatsuya Ishihara, Kris Kitani, Chieko Asakawa · 2020 · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

  ReCog is a smartphone application designed to help blind users recognize their own personal objects — items like specific clothing, handmade goods, medicines, or family photos that cannot be identified by general-purpose recognizers such as Seeing AI or TapTapSee. The authors…

  visual impairment · blindness · object recognition · computer vision · deep learning

• Supporting Older Adults in Using Complex User Interfaces with Augmented Reality

  Junhan Kong, Anhong Guo, Jeffrey P. Bigham · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This demonstration paper presents an augmented reality system that provides step-by-step visual guidance to help older adults navigate complex user interfaces. The core problem is that older adults frequently struggle with complex digital interfaces — from self-service kiosks…

  older adults · aging · augmented reality · cognitive support · user interface

• Delivering Sign Language in a Live Planetarium Show Using Head-Mounted Displays and Infrared Light

  Michael D. Jones, M. Jeannette Lawler · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper presents a system for delivering real-time American Sign Language (ASL) narration during live planetarium shows using head-mounted displays (HMDs) and infrared light. Planetariums pose unique accessibility challenges for deaf and hard-of-hearing (DHH) audiences: the…

  sign language · deaf and hard of hearing · head-mounted display · augmented reality · informal learning

• Leveraging Augmented Reality to Create Apps for People with Visual Disabilities: A Case Study in Indoor Navigation

  Chris Yoon, Ryan Louie, Jeremy Ryan, MinhKhang Vu, Hyegi Bang, William Derksen, Paul Ruvolo · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper presents Clew, an iOS app that leverages Apple’s ARKit augmented reality framework to help people who are blind or visually impaired (B/VI) navigate indoor environments — a setting where GPS is unreliable (accuracy drops to ~5m+ indoors). Clew uses visual-inertial…

  augmented reality · indoor navigation · orientation and mobility · blind · low vision

• WebSight: Using AR and WebGL shaders to assist the visually impaired

  Dan Ruta, Louis Jordan, Tom James Fox, Rich Boakes · 2018 · Proceedings of the 15th International Web for All Conference (W4A 2018)

  This demonstration paper presents WebSight, a browser-based augmented reality system that uses WebGL shaders to process a smartphone’s live camera feed in real time, enhancing visual features to assist people with low vision in navigating real-world environments. An estimated…

  augmented reality · low vision · visual impairment · WebGL · edge detection

• Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing

  Dhruv Jain, Rachel Franz, Leah Findlater, Jackson Cannon, Raja Kushalnagar, Jon Froehlich · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18)

  This paper presents two studies examining the communication needs of deaf and hard of hearing (DHH) people in mobile contexts (walking, transit, recreational activities) and the potential for head-mounted display (HMD) captions to address those needs. Prior research on DHH…

  deaf and hard of hearing · real-time captioning · augmented reality · head-mounted display · mobile accessibility

• Design of an Augmented Reality Magnification Aid for Low Vision Users

  Lee Stearns, Leah Findlater, Jon E. Froehlich · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18)

  This paper explores the design space for augmented reality magnification aids for people with low vision, developing and iteratively refining two prototype systems using the Microsoft HoloLens. Unlike existing head-mounted displays that simply magnify 2D video from a camera,…

  low vision · augmented reality · magnification · wearable technology · head-mounted display

• Technology-Mediated Sight: A Case Study of Early Adopters of a Low Vision Assistive Technology

  Annuska Zolyomi, Anushree Shukla, Jaime Snyder · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This qualitative case study examines the psychosocial and adaptive experiences of early adopters of the eSight 2.0 — a head-mounted assistive device for people with low vision that captures live video and displays enhanced images on high-resolution OLED screens inside…

  low vision · assistive technology · head-mounted display · qualitative research · disability identity

• Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments

  Thomas Kosch, Romina Kettner, Markus Funk, Albrecht Schmidt · 2016 · Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16)

  This paper compares three modalities of error feedback — tactile, auditory, and visual — for cognitively impaired workers performing manual assembly tasks at sheltered work organizations. Industrial manufacturing companies increasingly outsource assembly tasks to these…

  cognitive accessibility · intellectual disability · workplace accessibility · assistive technology · multimodal interaction

• ForeSee: A Customizable Head-Mounted Vision Enhancement System for People with Low Vision

  Yuhang Zhao, Sarit Szpiro, Shiri Azenkot · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This paper presents ForeSee, a video see-through augmented reality system that enhances the visual experience for people with low vision. Unlike assistive technologies that bypass vision entirely (like screen readers), ForeSee leverages users' remaining functional vision—which…

  low vision · augmented reality · head-mounted display · vision enhancement · magnification

• Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace

  Markus Funk, Sven Mayer, Albrecht Schmidt · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This research investigates whether projecting assembly instructions directly onto a workspace (in-situ projection) can help cognitively impaired workers complete more complex tasks compared to traditional pictorial instructions. The work addresses a significant barrier to…

  cognitive disability · workplace accessibility · augmented reality · in-situ projection · sheltered work

• Can a Blind Person Understand Your World?

  Chieko Asakawa · 2014 · Proceedings of the 11th Web for All Conference (W4A)

  This keynote paper by Chieko Asakawa of IBM Research presents a vision for the next frontier of accessibility for blind people: moving from digital information access to real-world understanding through cognitive computing. Asakawa charts the exponential growth of accessible…

  blindness · cognitive assistance · image recognition · computer vision · machine learning

• Introduction to the Talking Points Project

  Scott Gifford, Jim Knox, Jonathan James, Atul Prakash · 2006 · Proceedings of the 8th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '06)

  This paper introduces the Talking Points project from the University of Michigan, a system that attaches digital information to physical places and objects using passive RFID tags, creating an accessible "augmented reality" for blind and visually impaired users. The motivation…

  visual impairment · RFID · wayfinding · location awareness · ubiquitous computing

• Augmenting Home and Office Environments

  Elizabeth Mynatt, Douglas Blattner, Meera M. Blattner, Blair MacIntyre, Jennifer Mankoff · 1998 · Proceedings of the Third International ACM Conference on Assistive Technologies (Assets '98)

  This panel paper brings together five researchers from Xerox PARC, CommunityVision Inc., UC Davis/Lawrence Livermore, Columbia University, and Georgia Tech to discuss how augmented environments — homes and offices enhanced with sensors, computing, and multimodal interfaces — can…

  home automation · augmented reality · ubiquitous computing · smart environments · multimodal interface