Reviews

Search results

• CuCap: Comparative Analysis of Customized Captioning between North American and South Korean d/Deaf and Hard-of-Hearing Users

  Caluã de Lacerda Pataca, SooYeon Ahn, Suhyeon Yoo, JooYeong Kim, Khai N. Truong, Jin-Hyuk Hong, Roshan L Peiris, Matt Huenerfauth · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces CuCap, a customizable captioning system that allows d/Deaf and Hard-of-Hearing (DHH) users to personalize how paralinguistic speech features are visually represented in captions. Traditional captions convey only the words spoken, losing important…

  deaf and hard of hearing · captioning · customization · cross-cultural study · speech prosody

• Understanding the Video Content Creation Journey of Creators with Sensory Impairment in Kenya

  Lan Xiao, Maryam Bandukda, Franklin Mingzhe Li, Mark Colley, Catherine Holloway · 2025 · Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2025)

  This paper presents the first in-depth qualitative study of video content creation by people with visual and hearing impairments in a low- and middle-income country (LMIC) context, specifically Kenya. The researchers conducted semi-structured interviews with 20 video creators in…

  video content creation · sensory impairment · visual impairment · deaf and hard of hearing · low- and middle-income countries

• Joint Bilingual Navigation of Informed Consent and Intake Forms in American Sign Language and Written English

  Matthew Seita, Michaela Usha, Rachel Skwersky, Poorna Kushalnagar, Raja Kushalnagar · 2025 · Proceedings of the 22nd International Web for All Conference (W4A 2025)

  This paper presents a joint bilingual informed consent and intake form that can be navigated simultaneously in American Sign Language (ASL) and written English, addressing a critical accessibility barrier for the approximately 500,000 Americans who primarily use ASL. Current…

  deaf and hard of hearing · sign language recognition · informed consent · healthcare accessibility · American Sign Language

• Notification Designs for Influencing Hearing Speakers' Behaviors During Captioned Conversations Among Mixed DHH-Hearing Groups

  Matthew Seita, Sarah Andrew, Matt Huenerfauth · 2025 · Proceedings of the 22nd International Web for All Conference (W4A 2025)

  This paper investigates notification system designs that prompt hearing speakers to adjust their speech behaviors (speaking slower, louder, or more clearly) during ASR-captioned videoconference conversations with Deaf and Hard of Hearing (DHH) participants. The researchers…

  deaf and hard of hearing · automatic speech recognition · captioning · notification design · videoconferencing

• Improving the User Experience for Sign Language Interpreters in Remote Interpretation for Small Group Settings

  Roshan Mathew, Wendy Dannels · 2025 · Proceedings of the 22nd International Web for All Conference (W4A 2025)

  This study investigates whether increasing a sign language interpreter's visual access to a deaf client's environment through wider field-of-view (FoV) webcams and customizable screen layouts can enhance the user experience of remote small group interpretation. In traditional…

  video remote interpreting · sign language interpreting · deaf and hard of hearing · videoconferencing · field of view

• Barriers to Employment: The Deaf Multimedia Authoring Tax

  Christian Vogler, Abraham Glasser, Raja Kushalnagar, Matthew Seita, Mariana Arroyo Chavez, Keith Delk, Paige DeVries, Molly Feanny, Bernard Thompson, James Waller · 2025 · Proceedings of the 22nd International Web for All Conference (W4A)

  This paper from Gallaudet University describes through firsthand experience the enormous additional burden — termed the "deaf multimedia authoring tax" — that deaf and hard of hearing (DHH) people face when creating accessible multimedia content for the workplace. Written by a…

  deaf and hard of hearing · sign language · content creation · workplace accessibility · captioning

• Tactile Emotions: Multimodal Affective Captioning with Haptics Improves Narrative Engagement for d/Deaf and Hard-of-Hearing Viewers

  Caluã de Lacerda Pataca, Saad Hassan, Lloyd May, Michelle M Olson, Toni D'aurio, Roshan L Peiris, Matt Huenerfauth · 2025 · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems (CHI '25)

  This paper explores a multimodal approach to affective captioning — captions that convey not just the words a speaker says but the emotional dimensions of their voice — for d/Deaf and Hard-of-Hearing (dhh) viewers. Prior work has shown that typographic modulations such as…

  affective captioning · haptics · deaf and hard of hearing · multimodal interaction · captions

• Envisioning Collective Communication Access: A Theoretically-Grounded Review of Captioning Literature from 2013-2023

  Emma J. McDonnell, Leah Findlater · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '24)

  This paper synthesises thinking from four fields — disability studies, Deaf studies, disability justice, and communication studies — into a framework of collective communication access, then uses it to analyse a decade of HCI captioning research (2013–2023). The authors argue…

  captioning · deaf and hard of hearing · collective access · disability justice · disability studies

• ZINinNGT: A Mobile Tool to Aid Hearing Parents Learning Dutch Sign Language

  Jos Ritmeester, Beyza Sümer, Marije Boonstra, Maartje de Meulder, Belinda van der Aa, Floris Roelofsen · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '24)

  This short paper examines the potential of ZINinNGT, a mobile learning application designed to help hearing parents of deaf and hard-of-hearing (DHH) children learn Dutch Sign Language (Nederlandse Gebarentaal, NGT). The research addresses a critical communication gap: over 90%…

  sign language · deaf and hard of hearing · language learning · mobile application · family communication

• SoundModVR: Sound Modifications in Virtual Reality to Support People who are Deaf and Hard of Hearing

  Xinyun Cao, Dhruv Jain · 2024 · Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '24)

  This paper challenges the prevailing approach to VR sound accessibility for deaf and hard-of-hearing (DHH) people, which has focused almost exclusively on substituting audio with visual or haptic alternatives (captions, flashing indicators, vibrations). The authors argue that…

  deaf and hard of hearing · virtual reality · sound modification · audio accessibility · partial hearing

• SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing Users

  Pratheep Kumar Chelladurai, Ziming Li, Maximilian Weber, Tae Oh, Roshan L Peiris · 2024 · ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper presents SoundHapticVR, a head-based haptic feedback system that converts spatial audio cues in virtual reality into vibrotactile feedback for Deaf and Hard of Hearing (DHH) users. VR environments rely heavily on spatial audio to convey critical information — alerting…

  deaf and hard of hearing · haptics · virtual reality · sound localization · sensory substitution

• Design and Evaluation of an Automatic Text Simplification Prototype with Deaf and Hard-of-hearing Readers

  Oliver Alonzo, Sooyeon Lee, Akhter Al Amin, Mounica Maddela, Wei Xu, Matt Huenerfauth · 2024 · ASSETS '24: Proceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper investigates the design preferences and interactions of Deaf and Hard-of-Hearing (DHH) readers with automatic text simplification (ATS) tools. Many DHH individuals who use sign language as their primary language experience English as a second language with different…

  deaf and hard of hearing · text simplification · reading accessibility · natural language processing · lexical simplification

• Exploring the SoundVizVR Plugin in the Development of Sound-Accessible Virtual Reality Games: Insights from Game Developers and Players

  Yuxin Li, Roshan Lalintha Peiris · 2024 · Proceedings of the ACM on Human-Computer Interaction (CSCW)

  This paper presents SoundVizVR, a Unity plugin designed to make virtual reality games accessible to deaf and hard of hearing (DHH) users by visualizing in-game sounds. The research addresses a significant gap in VR accessibility—while visual content has received attention…

  VR accessibility · deaf and hard of hearing · sound visualization · game development · assistive technology

• Exploring the Benefits and Applications of Video-Span Selection and Search for Real-Time Support in Sign Language Video Comprehension among ASL Learners

  Saad Hassan, Caluã de Lacerda Pataca, Akhter Al Amin, Laleh Nourian, Diego Navarro, Sooyeon Lee, Alexis Gordon, Matthew Watkins, Garreth W. Tigwell, Matt Huenerfauth · 2024 · ACM Transactions on Accessible Computing

  This research investigates how to better support hearing students learning American Sign Language (ASL) when they encounter unfamiliar signs in video content. Existing ASL dictionary tools present significant barriers: they require learners to either recall and enter linguistic…

  American Sign Language · sign language learning · video comprehension · dictionary lookup · Deaf and hard of hearing

• Measuring the Accuracy of Automatic Speech Recognition Solutions

  Korbinian Kuhn, Verena Kersken, Benedikt Reuter, Niklas Egger, Gottfried Zimmermann · 2024 · ACM Transactions on Accessible Computing

  This study provides independent, comprehensive benchmarking of 11 common automatic speech recognition (ASR) services to assess their real-world accuracy for accessibility purposes. The research addresses a critical gap: while vendors claim "state-of-the-art accuracy" and…

  automatic speech recognition · ASR · captions · deaf and hard of hearing · transcription

• Caption Royale: Exploring the Design Space of Affective Captions from the Perspective of Deaf and Hard-of-Hearing Individuals

  Caluã de Lacerda Pataca, Saad Hassan, Nathan Tinker, Roshan Lalintha Peiris, Matt Huenerfauth · 2024 · CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

  This CHI 2024 paper from Rochester Institute of Technology and Tulane tackles a concrete design question: if we want captions to convey a speaker's emotion — not just their words — which typographic modulations should we use? Prior work had established that affective captions…

  captioning · affective captions · expressive captions · typography · valence

• Modeling Word Importance in Conversational Transcripts: Toward improved live captioning for Deaf and hard of hearing viewers

  Akhter Al Amin, Saad Hassan, Matt Huenerfauth, Cecilia O. Alm · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates how to model word importance in conversational transcripts to improve live captioning quality for Deaf and hard of hearing (DHH) viewers. Live captions generated by automatic speech recognition (ASR) systems inevitably contain errors, but not all errors…

  live captioning · deaf and hard of hearing · automatic speech recognition · word importance · natural language processing

• The State of Accessibility in Blackboard: Survey and User Reviews Case Study

  Wajdi Aljedaani, Mohammed Alkahtani, Stephanie Ludi, Mohamed Wiem Mkaouer, Marcelo M. Eler, Marouane Kessentini, Ali Ouni · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates the accessibility of the Blackboard mobile app, one of the most widely used Learning Management Systems (LMS) in higher education, through a two-pronged methodology. First, the authors conducted a large-scale survey with 1,308 hearing students and 65 deaf…

  mobile accessibility · learning management systems · deaf and hard of hearing · education accessibility · user reviews

• Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2023 · Proceedings of the 20th International Web for All Conference (W4A '23)

  This study investigates how Deaf and Hard of Hearing (DHH) viewers distribute their visual attention across different information regions on screen while watching captioned live television news. More than 360 million people worldwide are DHH, and many rely on captions to access…

  deaf and hard of hearing · captioning · eye tracking · television accessibility · caption placement

• Who is speaking: Unpacking In-text Speaker Identification Preference of Viewers who are Deaf and Hard of Hearing while Watching Live Captioned Television Program

  Akhter Al Amin, Joseph Mendis, Raja Kushalnagar, Christian Vogler, Matt Huenerfauth · 2023 · Proceedings of the 20th International Web for All Conference (W4A '23)

  This study systematically investigates how the number of speakers onscreen in live television programs affects Deaf and Hard of Hearing (DHH) viewers' preferences for different in-text speaker identification methods in captions. Live TV news and interviews often feature multiple…

  deaf and hard of hearing · captioning · live captioning · television accessibility · caption quality

• AdaptiveSound: An Interactive Feedback-Loop System to Improve Sound Recognition for Deaf and Hard of Hearing Users

  Hang Do, Quan Dang, Jeremy Zhengqi Huang, Dhruv Jain · 2023 · ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces AdaptiveSound, the first feedback-loop sound recognition system designed for deaf and hard of hearing (DHH) users. Sound recognition tools help DHH people become aware of environmental sounds ranging from safety-critical alerts like fire alarms and sirens…

  deaf and hard of hearing · sound recognition · human-in-the-loop · machine learning · incremental learning

• Jod: Examining Design and Implementation of a Videoconferencing Platform for Mixed Hearing Groups

  Mittal, Anant, Gupta, Meghna, Poddar, Roshni, Naik, Tarini, Kuppuraj, Seethalakshmi, Fogarty, James, Kumar, Pratyush, Jain, Mohit · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents the design, implementation, and evaluation of Jod (a Hindi word meaning "link"), a web-based videoconferencing platform purpose-built for mixed hearing group communication. Current platforms like Zoom, Teams, and Google Meet present significant accessibility…

  deaf and hard of hearing · videoconferencing · sign language · mixed hearing groups · visual layout

• User Perceptions and Preferences for Online Surveys in American Sign Language: An Exploratory Study

  Rachel Boll, Shruti Mahajan, Tish Burke, Khulood Alkhudaidi, Brittany Henriques, Isabelle Cordova, Zoey Walker, Erin T. Solovey, Jeanne Reis · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents SL-Surveys, an interactive prototype survey tool designed from the ground up for American Sign Language (ASL) rather than retrofitting text-based survey platforms with ASL video content. The research team, which included Deaf ASL-signing researchers,…

  deaf and hard of hearing · American Sign Language · survey design · user experience · ASL-centric design

• "Not There Yet": Feasibility and Challenges of Mobile Sound Recognition to Support Deaf and Hard-of-Hearing People

  Jeremy Zhengqi Huang, Hriday Chhabria, Dhruv Jain · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents the first longitudinal field study of a mobile sound recognition system used by Deaf and hard of hearing (DHH) people in their daily lives. The researchers deployed SoundWatch, a smartwatch-based app that uses a deep learning model (Google YAMNet…

  deaf and hard of hearing · sound recognition · wearable technology · smartwatch · assistive technology

• Enhancing Non-Speech Information Communicated in Closed Captioning Through Critical Design

  May, Lloyd, Park, So Yeon, Berger, Jonathan · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper investigates the communication of non-speech information (NSI) in closed captioning for d/Deaf and hard of hearing (DHH) viewers through a mixed-methods study combining needfinding interviews, prototype development, surveys, and evaluation interviews with 20 DHH…

  captioning · non-speech information · deaf and hard of hearing · critical design · sound communication