Reviews

Search results

• Comparison of Methods for Evaluating Complexity of Simplified Texts among Deaf and Hard-of-Hearing Adults at Different Literacy Levels

  Oliver Alonzo, Jessica Trussell, Becca Dingman, Matt Huenerfauth · 2021 · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21)

  This CHI 2021 paper is the companion methodological study to Alonzo et al.'s 2022 fluency work: where that later paper asked how to evaluate the fluency (grammaticality) of simplified texts, this one asks how to evaluate their complexity (whether the simplification actually made…

  automatic text simplification · deaf and hard of hearing · readability · reading accessibility · research methodology

• Design for Social Accessibility Method Cards: Engaging Users and Reflecting on Social Scenarios for Accessible Design

  Kristen Shinohara, Cynthia L. Bennett, Wanda Pratt, Jacob O. Wobbrock · 2020 · ACM Transactions on Accessible Computing (TACCESS)

  This paper introduces Design for Social Accessibility (DSA) method cards, a practical tool that helps designers incorporate social dimensions of accessibility into their work. The authors argue that most accessibility guidelines focus on functional access — ensuring technology…

  social accessibility · design methods · method cards · participatory design · deaf and hard of hearing

• Fairness Issues in AI Systems that Augment Sensory Abilities

  Leah Findlater, Steven Goodman, Yuhang Zhao, Shiri Azenkot, Margot Hanley · 2020 · SIGACCESS Accessibility and Computing

  This paper examines the unique fairness challenges that arise when AI systems are used to augment sensory abilities for people with disabilities — a context distinct from other AI applications because these systems provide information that is already available to non-disabled…

  AI fairness · sensory augmentation · visual impairment · deaf and hard of hearing · privacy

• Artificial Intelligence Fairness in the Context of Accessibility Research on Intelligent Systems for People Who Are Deaf or Hard of Hearing

  Sushant Kafle, Abraham Glasser, Sedeeq Al-khazraji, Larwan Berke, Matthew Seita, Matt Huenerfauth · 2020 · SIGACCESS Accessibility and Computing

  This paper from RIT's Center for Accessibility and Inclusion Research discusses AI fairness issues specifically through the lens of the authors' extensive research on intelligent systems for people who are Deaf or Hard of Hearing (DHH). The authors identify five interconnected…

  AI fairness · deaf and hard of hearing · automatic speech recognition · captioning · evaluation metrics

• Deaf and hard-of-hearing users’ prioritization of genres of online video content requiring accurate captions

  Larwan Berke, Matthew Seita, Matt Huenerfauth · 2020 · Proceedings of the 17th International Web for All Conference (W4A)

  This paper investigates which genres of online video content Deaf and Hard-of-Hearing (DHH) users consider most important to have accurately captioned. With over 400 hours of video uploaded to YouTube every minute and no U.S. legal mandate to caption all online video (especially…

  deaf and hard of hearing · captioning · video accessibility · automatic speech recognition · user research

• Reading Experiences and Interest in Reading-Assistance Tools Among Deaf and Hard-of-Hearing Computing Professionals

  Oliver Alonzo, Lisa Elliot, Becca Dingman, Matt Huenerfauth · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This study investigates whether Deaf and Hard-of-Hearing (DHH) computing professionals are interested in Automatic Text Simplification (ATS) tools to assist with reading in their professional work. ATS software rewrites text to improve readability using lexical simplification…

  deaf and hard of hearing · automatic text simplification · reading accessibility · natural language processing · assistive technology

• Access Differential and Inequitable Access: Inaccessibility for Doctoral Students in Computing

  Kristen Shinohara, Michael McQuaid, Nayeri Jacobo · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This paper investigates why the pipeline of students with disabilities pursuing doctoral degrees in computing remains so thin, despite increased support at the undergraduate level. In 2018, the NSF reported that only about 3% of math and computer science PhD recipients…

  education accessibility · disability rights · deaf and hard of hearing · blindness and low vision · digital accessibility

• Student and Teacher Perspectives of Learning ASL in an Online Setting

  Garreth W. Tigwell, Roshan L Peiris, Stacey Watson, Gerald M. Garavuso, Heather Miller · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2020)

  This experience report examines the challenges and opportunities of teaching and learning American Sign Language (ASL) online during the COVID-19 pandemic, from the perspectives of both students and a Deaf instructor at Rochester Institute of Technology (RIT), home of the…

  deaf and hard of hearing · sign language · education accessibility · videoconferencing · remote learning

• Breaking Boundaries with Live Transcribe: Expanding Use Cases Beyond Standard Captioning Scenarios

  Fernando Loizides, Sara Basson, Dimitri Kanevsky, Olga Prilepova, Sagar Savla, Susanna Zaraysky · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This short paper catalogs non-traditional, serendipitous uses of Google's Live Transcribe, a free Android application that provides real-time speech-to-text transcription in over 80 languages. The authors — a mix of Google developers, researchers, and DHH users (co-creator…

  automatic speech recognition · deaf and hard of hearing · captioning · speech to text · COVID-19

• Chat in the Hat: A Portable Interpreter for Sign Language Users

  Larwan Berke, William Thies, Danielle Bragg · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper addresses a fundamental limitation of Video Remote Interpreting (VRI) for Deaf and Hard-of-Hearing (DHH) sign language users: existing smartphone-based VRI requires the DHH person to either hold the phone with one hand (reducing signing to one-handed and causing…

  deaf and hard of hearing · sign language · video remote interpreting · augmented reality · workplace accessibility

• A Portable Hong Kong Sign Language Translation Platform with Deep Learning and Jetson Nano

  Zhenxing Zhou, Yisiang Neo, King-Shan Lui, Vincent W.L. Tam, Edmund Y. Lam, Ngai Wong · 2020 · Proceedings of the 22nd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This demonstration paper presents a portable platform for translating Hong Kong Sign Language (HKSL) into spoken language using deep learning and edge computing hardware. The system addresses a significant communication gap: Hong Kong has over 155,000 deaf or hard of hearing…

  sign language recognition · deep learning · edge computing · mobile accessibility · deaf and hard of hearing

• Automated Class Discovery and One-Shot Interactions for Acoustic Activity Recognition

  Jason Wu, Chris Harrison, Jeffrey P. Bigham, Gierad Laput · 2020 · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20)

  This paper presents Listen Learner, an end-to-end system for acoustic activity recognition that automatically discovers and learns to classify environmental sounds with minimal user effort. Traditional approaches to sound recognition face a tradeoff: custom models trained in a…

  acoustic activity recognition · smart home · machine learning · Internet of Things · context awareness

• Deaf Individuals' Views on Speaking Behaviors of Hearing Peers when Using an Automatic Captioning App

  Matthew Seita, Matt Huenerfauth · 2020 · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20)

  This CHI 2020 Late-Breaking Work paper investigates what behaviors hearing speakers should ideally exhibit when holding in-person conversations with Deaf or deaf people using an Automatic Speech Recognition (ASR) captioning app on a mobile device. The authors position the study…

  automatic speech recognition · deaf and hard of hearing · captioning · captions · speaking behavior

• Accessibility for Deaf and Hard of Hearing Users: Sign Language Conversational User Interfaces

  Abraham Glasser, Vaishnavi Mande, Matt Huenerfauth · 2020 · Proceedings of the 2nd Conference on Conversational User Interfaces (CUI '20)

  This short CUI 2020 position paper (3 pages, presented at the CUI@CHI workshop) lays out the research agenda for making voice-based conversational user interfaces (CUIs) — Alexa, Google Assistant, and similar personal assistant devices — accessible to Deaf and Hard-of-Hearing…

  deaf and hard of hearing · sign language · conversational user interfaces · personal assistants · american sign language

• Automatic Text Simplification Tools for Deaf and Hard of Hearing Adults: Benefits of Lexical Simplification and Providing Users with Autonomy

  Oliver Alonzo, Matthew Seita, Abraham Glasser, Matt Huenerfauth · 2020 · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20)

  This CHI 2020 paper is the first empirical study of lexical Automatic Text Simplification (ATS) with Deaf and Hard-of-Hearing (DHH) adult readers, and introduces user autonomy as a central design variable in accessibility ATS tools. Prior ATS research with DHH users had looked…

  automatic text simplification · deaf and hard of hearing · lexical simplification · user autonomy · reading accessibility

• Empirical Investigation of Users' Preferred Timing Parameters for American Sign Language Animations

  Sedeeq Al-khazraji, Becca Dingman, Matt Huenerfauth · 2020 · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20)

  This CHI 2020 Late-Breaking Work (7 pages) investigates a narrow but consequential HCI question: what timing values should be used when generating American Sign Language (ASL) animations from a script, so that Deaf viewers find them comfortable to watch? ASL is a primary…

  american sign language · sign language animation · signing avatar · deaf and hard of hearing · web accessibility

• Sign Language Interfaces: Discussing the Field's Biggest Challenges

  Danielle Bragg, Meredith Ringel Morris, Christian Vogler, Raja Kushalnagar, Matt Huenerfauth, Hernisa Kacorri · 2020 · Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20)

  This CHI 2020 Special Interest Group (SIG) meeting paper (5 pages) is an organising document rather than a conventional research paper. It convenes HCI and accessibility researchers working on sign-language interfaces around the five calls-to-action laid out in Bragg et al.’s…

  sign language · deaf and hard of hearing · deaf culture · american sign language · research methodology

• Design and Psychometric Evaluation of American Sign Language Translations of Usability Questionnaires

  Larwan Berke, Matt Huenerfauth, Kasmira Patel · 2019 · ACM Transactions on Accessible Computing (TACCESS)

  This paper presents the first formally translated and psychometrically validated American Sign Language (ASL) versions of two widely used usability questionnaires: the System Usability Scale (SUS) and the Net Promoter Score (NPS). Many deaf adults in the United States have lower…

  American Sign Language · deaf and hard of hearing · usability questionnaires · psychometrics · SUS

• Predicting the Understandability of Imperfect English Captions for People Who Are Deaf or Hard of Hearing

  Sushant Kafle, Matt Huenerfauth · 2019 · ACM Transactions on Accessible Computing (TACCESS)

  This paper tackles a fundamental measurement problem in ASR-based captioning for Deaf and Hard-of-Hearing (DHH) users: the standard Word Error Rate (WER) metric has little correlation with how DHH users actually perceive caption quality. WER treats all word errors as equally…

  automatic speech recognition · captioning · deaf and hard of hearing · evaluation metrics · word error rate

• Tradeoffs in the Efficient Detection of Sign Language Content in Video Sharing Sites

  Caio D. D. Monteiro, Frank M. Shipman, Satyakiran Duggina, Ricardo Gutierrez-Osuna · 2019 · ACM Transactions on Accessible Computing (TACCESS)

  This paper addresses the problem of finding sign language (SL) content on video sharing sites like YouTube, where such videos serve as de-facto digital libraries of Deaf community knowledge, experiences, and culture. Metadata-based search is inadequate — prior work showed only…

  sign language · video analysis · content detection · deaf and hard of hearing · computer vision

• Evaluating the Benefit of Highlighting Key Words in Captions for People who are Deaf or Hard of Hearing

  Sushant Kafle, Peter Yeung, Matt Huenerfauth · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper investigates whether visually highlighting important words in video captions benefits Deaf and Hard of Hearing (DHH) users, through formative studies and a larger evaluation study. DHH users face a unique visual-attention challenge when watching captioned video: they…

  Deaf and hard of hearing · captioning · text highlighting · educational accessibility · video accessibility

• Autoethnography of a Hard of Hearing Traveler

  Dhruv Jain, Audrey Desjardins, Leah Findlater, Jon E. Froehlich · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents a 2.5-year autoethnographic account of the recreational travel experiences of Jain, a hard of hearing individual with severe-to-profound bilateral sensorineural hearing loss who wears behind-the-ear hearing aids. The account draws on retrospective journals…

  hard of hearing · Deaf and hard of hearing · autoethnography · accessible tourism · disability disclosure

• Delivering Sign Language in a Live Planetarium Show Using Head-Mounted Displays and Infrared Light

  Michael D. Jones, M. Jeannette Lawler · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper presents a system for delivering real-time American Sign Language (ASL) narration during live planetarium shows using head-mounted displays (HMDs) and infrared light. Planetariums pose unique accessibility challenges for deaf and hard-of-hearing (DHH) audiences: the…

  sign language · deaf and hard of hearing · head-mounted display · augmented reality · informal learning

• Effect of Automatic Sign Recognition Performance on the Usability of Video-Based Search Interfaces for Sign Language Dictionaries

  Oliver Alonzo, Abraham Glasser, Matt Huenerfauth · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper investigates how the performance of automatic sign recognition technology affects user satisfaction when searching for unfamiliar words in an ASL-to-English dictionary. Looking up an unknown sign in ASL is fundamentally harder than looking up an unknown written word:…

  sign language · ASL · sign language recognition · dictionary · Deaf and hard of hearing

• Exploration of Automatic Speech Recognition for Deaf and Hard of Hearing Students in Higher Education Classes

  Janine Butler, Brian Trager, Byron Behm · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2019)

  This paper presents a qualitative study of how deaf and hard of hearing (DHH) students at the National Technical Institute for the Deaf (Rochester Institute of Technology) experienced automatic speech recognition (ASR) as a supplemental access service in mainstream higher…

  speech recognition · Deaf and hard of hearing · captioning · higher education · real-time captions