Reviews

Search results

• Beyond Technical Metrics: Understanding the Gap Between AI Performance and Deaf User Experience in Chinese Natural Sign Language Generation

  Yang Liu, Hui Kang, Yurun He, Jiahui Li · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  This CHI 2026 paper investigates the disconnect between technical performance metrics and actual Deaf user experience in AI-generated Chinese Natural Sign Language (CNSL). The authors argue that existing sign language generation research, dominated by hearing researchers, relies…

  sign language generation · deaf accessibility · AI accessibility · participatory design · human-centered evaluation

• AuslanSpell: An Interactive Technology for Improving Auslan Fingerspelling Comprehension

  Kalin Stefanov, Andre Ky Pham, Antony Smith Loose, Lucy M Robertson-Bell, Louisa Jane Vaughan Willoughby · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  AuslanSpell is an interactive learning tool that converts arbitrary English text into 3D motion-captured animations of Australian Sign Language (Auslan) fingerspelling, targeting hearing learners who struggle with the hardest part of sign-language learning: reading…

  Auslan · fingerspelling · sign language · signing avatar · language learning

• Reimagining Sign Language Technologies: Analyzing Translation Work of Chinese Deaf Online Content Creators

  Xinru Tang, Anne Marie Piper · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Tang and Piper investigate the translation practices of thirteen deaf Chinese online content creators who produce sign language videos for Kuaishou, Bilibili, Douyin, WeChat, and Xiaohongshu, reaching audiences that range from thousands to nearly a quarter million followers. The…

  sign language · deaf accessibility · sign language translation · content creators · translanguaging

• Designing a Generative AI-Assisted Music Psychotherapy Tool for Deaf and Hard-of-Hearing Individuals

  Youjin Choi, JaeYoung Moon, JinYoung Yoo, Jennifer G. Kim, Jin-Hyuk Hong · 2026 · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)

  Choi and colleagues designed, built, and evaluated a generative-AI music psychotherapy tool co-designed with licensed Korean music therapists for deaf and hard-of-hearing (DHH) users. The work is motivated by the observation that music psychotherapy — which uses songwriting,…

  music therapy · deaf accessibility · DHH · generative AI · conversational agent

• LaboSignes: an Interactive French Sign Language Recognition Interface

  Jules Françoise, Julie Lascar, Cyril Verrechia, Sidonie Minodier, Michèle Gouiffès, Annelies Braffort · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA ’26)

  LaboSignes is a web-based interactive French Sign Language (LSF) recognition system aimed at search-by-sign, addressing the fact that most online resources, including bilingual dictionaries and news sites, are navigable only through written French, which is a second language for…

  sign language · French Sign Language · sign language recognition · Deaf accessibility · gesture recognition

• ArtfulSign: A Closed-Loop, Semantics-Grounded Mobile System for Learning Chinese Sign Language

  Yuan Zhao, Yueran Wang, Chenglong Tan, Siyang Tong, Dengfeng Yao, Wei Zhen · 2026 · Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA '26)

  ArtfulSign is a mobile iOS application that reframes Chinese Sign Language (CSL) learning as an embodied skill practiced through short closed-loop interaction cycles rather than passive video consumption. The authors argue that most existing sign language learning tools - video…

  Chinese Sign Language · sign language learning · embodied learning · closed-loop interaction · semantic grounding

• Accessible Gaming Through Better Captions: A Study on Captions Preferences and Inclusivity of Deaf and Hard-of-Hearing Players

  Wajdi Aljedaani, Marcelo M. Eler, Lorene E Keeland, Hamed Jalali, Khaled Al-Raddah, Mohamed Wiem Mkaouer · 2024 · Proceedings of the 21st International Web for All Conference (W4A '24)

  This study surveys 73 deaf and hard-of-hearing (d/Deaf) individuals about their preferences for caption design in video games, addressing a significant gap: while captioning standards exist for television and film, there are no universally accepted standards for video game…

  deaf accessibility · captioning · game accessibility · video games · user preferences

• Using Convolutional Neural Networks for Visual Sign Language Recognition: Towards a system that provides instant feedback to learners of sign language

  Rami Aldahir, Ronald R. Grau · 2024 · Proceedings of the 21st International Web for All Conference (W4A)

  This short paper presents a prototype system that uses computer vision and a convolutional neural network (CNN) to recognize finger-spelled letters in British Sign Language (BSL), providing real-time feedback to learners. The system addresses a gap in sign language instruction:…

  sign language · British Sign Language · computer vision · deep learning · fingerspelling

• "Signifier" Video Sharing Platform and Accessible Media Player for Deaf Users

  Paraskevi Panagi, Alexandros Yeratziotis, Thomas Fotiadis, Christos Mettouris, George Angelos Papadopoulos · 2024 · Proceedings of the 2024 International Conference on Information Technology for Social Good (GoodIT)

  This paper from the University of Cyprus and Connect Deaf presents the "Signifier" video sharing platform and its integrated Signifier Accessible Media Player (SiAMP), designed specifically to address the lack of accessible video media for Deaf and Hard-of-Hearing (D & HH)…

  deaf accessibility · sign language · media accessibility · video accessibility · inclusive design

• The Sem-Lex Benchmark: Modeling ASL Signs and their Phonemes

  Lee Kezar, Jesse Thomason, Naomi Caselli, Zed Sehyr, Elana Pontecorvo · 2023 · ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces the Sem-Lex Benchmark, the largest curated dataset of its kind for American Sign Language (ASL) isolated sign recognition, containing over 84,000 videos of isolated sign productions from 41 deaf ASL signers. The dataset addresses two critical barriers in…

  sign language recognition · American Sign Language · machine learning · phonology · dataset

• Investigating Sign Language Interpreter Rendering and Guiding Methods in Virtual Reality 360-Degree Content

  Craig Anderton · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This paper explores how sign language interpretation can be effectively presented in virtual reality 360-degree (VR360) three-degrees-of-freedom video content. The research addresses a significant gap: while VR accessibility guidelines exist for subtitles, there has been almost…

  sign language · virtual reality · extended reality · 360-degree video · deaf accessibility

• Deaf and Hard-of-Hearing Users' Preferences for Hearing Speakers' Behavior during Technology-Mediated In-Person and Remote Conversations

  Matthew Seita, Sarah Andrew, Matt Huenerfauth · 2021 · Proceedings of the 18th International Web for All Conference (W4A)

  This paper presents the first quantitative evidence of Deaf and hard-of-hearing (DHH) individuals' preferences for specific speech and non-verbal behaviors from hearing conversational partners during technology-mediated communication. The researchers conducted two experimental…

  deaf and hard of hearing · automatic speech recognition · videoconferencing · communication accessibility · speechreading

• Teaching ASL Signs using Signing Avatars and Immersive Learning in Virtual Reality

  Lorna C. Quandt, Jason Lamberton, Athena S. Willis, Jianye Wang, Kaitlyn Weeks, Emily Kubicek, Melissa Malzkuhn · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This demonstration paper presents SAIL (Signing Avatars & Immersive Learning), the first ASL instructional system built for immersive virtual reality. Developed at Gallaudet University by a majority-Deaf team, SAIL uses a signing avatar — a computer-animated virtual human…

  sign language · American Sign Language · virtual reality · signing avatars · motion capture

• SoundWatch: Exploring Smartwatch-based Deep Learning Approaches to Support Sound Awareness for Deaf and Hard of Hearing Users

  Dhruv Jain, Hung Ngo, Pratyush Patel, Steven Goodman, Leah Findlater, Jon Froehlich · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '20)

  This paper presents SoundWatch, a smartwatch-based sound awareness system that uses deep learning to classify environmental sounds in real time and provide visual and haptic notifications to deaf and hard of hearing (DHH) users. The research addresses the finding from prior…

  deaf accessibility · hard of hearing · sound awareness · deep learning · wearable technology

• How to Develop Accessible Web Interfaces for Deaf People?

  Gênesis Medeiros do Carmo, Débora Maria Barroso Paiva, Maria Istela Cagnin · 2019 · Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (IHC)

  This paper presents a systematic mapping study examining how web interfaces are being designed and implemented for deaf and hard of hearing users. The authors searched six databases and 17 conferences from 2005-2018, screening 469 publications to select 29 primary studies. The…

  deaf accessibility · hard of hearing · web accessibility · systematic mapping · sign language

• Modeling the Speed and Timing of American Sign Language to Generate Realistic Animations

  Sedeeq Al-khazraji, Larwan Berke, Sushant Kafle, Peter Yeung, Matt Huenerfauth · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18)

  This paper addresses the challenge of generating realistic computer animations of American Sign Language (ASL) by automatically modeling three critical timing parameters: where prosodic pauses should be inserted, how long those pauses should last, and how the signing speed of…

  sign language · ASL · animation · machine learning · Deaf accessibility

• Designing an Animated Character System for American Sign Language

  Danielle Bragg, Raja Kushalnagar, Richard Ladner · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018)

  This University of Washington and Gallaudet University paper introduces the first animated character system prototype for sign language, addressing the fundamental problem that sign languages — used by approximately 70 million people worldwide as their primary language — lack a…

  sign language · deaf accessibility · ASL · writing systems · animation

• Scopist: Building a Skill Ladder into Crowd Transcription

  Jeffrey P. Bigham, Kristin Williams, Nila Banerjee, John Zimmerman · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

  This paper introduces Scopist, a JavaScript application designed to teach crowd workers stenotype — a chording-based text entry method used by professional real-time captioners — while they perform audio transcription microtasks. The research addresses a fundamental problem in…

  crowdsourcing · captioning · stenography · deaf accessibility · transcription

• Design and Psychometric Evaluation of an American Sign Language Translation of the System Usability Scale

  Matt Huenerfauth, Kasmira Patel, Larwan Berke · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17)

  This paper addresses a significant gap in accessibility research methodology: the lack of standardized usability questionnaires available in American Sign Language (ASL) for Deaf and Hard-of-Hearing (DHH) participants. The System Usability Scale (SUS) is one of the most widely…

  sign language · deaf accessibility · usability testing · survey translation · psychometrics

• Deaf and Hard-of-Hearing Perspectives on Imperfect Automatic Speech Recognition for Captioning One-on-One Meetings

  Larwan Berke, Christopher Caulfield, Matt Huenerfauth · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17)

  This paper investigates whether and how to display word-level confidence information from Automatic Speech Recognition (ASR) systems in real-time captions for Deaf and Hard-of-Hearing (DHH) users during one-on-one meetings with hearing people. ASR engines assign confidence…

  deaf accessibility · automatic speech recognition · captioning · communication · user research

• Refreshable Braille Oral Appliance

  M. A. Naomi Jobrack · 2015 · Proceedings of the 12th International Web for All Conference (W4A)

  This paper presents preliminary research toward developing a Refreshable Braille Oral Appliance (RBOA) — a refreshable Braille display embedded in an oral retainer that would allow users to read Braille with their tongue. The envisioned device connects to a wireless lapel…

  braille · haptics · refreshable display · deaf accessibility · assistive technology

• Online News Videos: The UX of Subtitle Position

  Michael Crabb, Rhianne Jones, Mike Armstrong, Chris J. Hughes · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This BBC-funded research investigates whether repositioning subtitles from their traditional placement within a video to below the video frame improves user experience for online news content. The study addresses a gap in captioning research: while television subtitling has…

  subtitles · captions · deaf accessibility · user experience · video accessibility

• Evaluating Alternatives for Better Deaf Accessibility to Selected Web-Based Multimedia

  Brent N. Shiver, Rosalee J. Wolfe · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This research addresses the accessibility gap created by the proliferation of uncaptioned video content online—a particular problem for deaf adults who use American Sign Language as their primary language and view English as a second language. While television captioning has…

  deaf accessibility · captions · automatic speech recognition · ASR · multimedia accessibility

• SlidePacer: Improving Class Pace for Deaf and Hard-of-Hearing Students

  Alessandra Brandao · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This short paper from Rochester Institute of Technology introduces SlidePacer, a prototype tool designed to synchronize PowerPoint slide transitions with sign language interpretation in university classrooms. The paper addresses a fundamental challenge for deaf and…

  deaf accessibility · sign language interpreters · education · classroom accessibility · multimedia learning

• Captions Versus Transcripts for Online Video Content

  Raja S. Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper investigates a fundamental challenge for deaf and hard of hearing (DHH) users consuming online video: while hearing viewers can watch and listen simultaneously using separate sensory channels, DHH viewers must process two competing visual streams — the video content…

  captioning · deaf accessibility · transcripts · online education · MOOCs