Reviews

Search results

• Access on Demand: Real-time, Multi-modal Accessibility for the Deaf and Hard-of-Hearing based on Augmented Reality

  Roshan Mathew, Brian Mak, Wendy Dannels · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This experience report documents two deaf researchers' hands-on evaluation of Access on Demand (AoD), an augmented reality application developed at Rochester Institute of Technology that delivers real-time captioning and American Sign Language (ASL) interpretation through Vuzix…

  augmented reality · deaf and hard of hearing · smart glasses · captioning · sign language interpretation

• Understanding Social and Environmental Factors to Enable Collective Access Approaches to the Design of Captioning Technology

  Emma McDonnell · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This doctoral consortium paper presents a dissertation research program that reimagines how captioning technology should be designed by applying the disability justice principle of collective access — the idea that accessibility is a shared responsibility of all group members,…

  captioning · collective access · disability justice · deaf and hard of hearing · co-design

• "It's Just Part of Me:" Understanding Avatar Diversity and Self-presentation of People with Disabilities in Social Virtual Reality

  Kexin Zhang, Elmira Deldari, Zhicong Lu, Yaxing Yao, Yuhang Zhao · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This paper investigates how people with disabilities (PWD) perceive, design, and use avatars for self-presentation and disability disclosure in social virtual reality (VR) platforms. The researchers employed a two-part methodology: first, a systematic review of 15 popular…

  social virtual reality · avatars · disability disclosure · self-presentation · deaf and hard of hearing

• Designing Gestures for Digital Musical Instruments: Gesture Elicitation Study with Deaf and Hard of Hearing People

  Ryo Iijima, Akihisa Shitara, Yoichi Ochiai · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This study addresses a gap in how deaf and hard of hearing (DHH) people can enjoy playing musical instruments using smartphones. While DHH people can and do enjoy music — often sensing it through vibrations transmitted by instruments or through body movements while performing —…

  deaf and hard of hearing · music accessibility · gesture elicitation · digital musical instruments · haptic feedback

• Beyond Subtitles: Captioning and Visualizing Non-speech Sounds to Improve Accessibility of User-Generated Videos

  Oliver Alonzo, Hijung Valentina Shin, Dingzeyu Li · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This paper investigates a significant gap in video captioning: the representation of non-speech sounds. While automatic speech recognition (ASR) has become widely available for generating captions on platforms like YouTube, TikTok, and Zoom, these systems focus exclusively on…

  deaf and hard of hearing · captioning · non-speech sounds · automatic captions · video accessibility

• Support in the Moment: Benefits and use of video-span selection and search for sign-language video comprehension among ASL learners

  Saad Hassan, Akhter Al Amin, Caluã de Lacerda Pataca, Diego Navarro, Alexis Gordon, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This paper investigates technology to support American Sign Language (ASL) learners in comprehending challenging sign-language videos by enabling in-context dictionary lookup. The researchers conducted two studies at Rochester Institute of Technology. Study 1 interviewed 14 ASL…

  sign language · American Sign Language · ASL · video comprehension · dictionary search

• Technical Perspective: Computation Where the (Inter)Action Is

  Jeffrey P. Bigham · 2022 · Communications of the ACM

  This one-page technical perspective accompanies the SoundWatch paper in Communications of the ACM. Bigham uses SoundWatch — a smartwatch prototype that detects audio events and displays descriptions for deaf and hard-of-hearing people — as a lens to explore broader questions…

  wearable technology · deaf and hard of hearing · sound recognition · smartwatch · assistive technology

• Analyzing Deaf and Hard-of-Hearing Users' Behavior, Usage, and Interaction with a Personal Assistant Device that Understands Sign-Language Input

  Abraham Glasser, Matthew Watkins, Kira Hart, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper investigates how Deaf and Hard-of-Hearing (DHH) ASL signers would actually use a personal assistant device (such as an Amazon Echo Show or Google Home) if it could understand American Sign Language commands. The authors position their work against the…

  sign language · american sign language · deaf and hard of hearing · personal assistants · voice assistants

• Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing Pairs

  Matthew Seita, Sooyeon Lee, Sarah Andrew, Kristen Shinohara, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper addresses two intertwined problems. First, methodologically, how can co-design research involving both Deaf/Hard-of-Hearing (DHH) and hearing participants be conducted remotely during and beyond COVID-19, when in-person sessions are not possible and masks…

  automatic speech recognition · deaf and hard of hearing · participatory design · co-design · videoconferencing

• Watch It, Don't Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper builds a better automated metric for the severity of caption-occlusion — the problem of closed captions blocking important on-screen visual content during television programming. DHH viewers consistently report that even perfectly transcribed captions become…

  captioning · captions · caption occlusion · deaf and hard of hearing · television accessibility

• Methods for Evaluating the Fluency of Automatically Simplified Texts with Deaf and Hard-of-Hearing Adults at Various Literacy Levels

  Oliver Alonzo, Jessica Trussell, Matthew Watkins, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper is a methodological study, not a product evaluation: the authors ask how researchers should measure the fluency of Automatic Text Simplification (ATS) output when the evaluators are Deaf and Hard-of-Hearing (DHH) adults spanning a wide range of English…

  automatic text simplification · deaf and hard of hearing · readability · reading accessibility · natural language processing

• Design and Evaluation of Hybrid Search for American Sign Language to English Dictionaries: Making the Most of Imperfect Sign Recognition

  Saad Hassan, Akhter Al Amin, Alexis Gordon, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper tackles a practical problem faced by the roughly 200,000 students currently studying American Sign Language (ASL) in the US: how do you look up the meaning of a sign you just saw when you don't know its English gloss? Unlike written languages, ASL has no…

  american sign language · sign language · sign language recognition · search interfaces · dictionary

12 results.