Reviews

Search results

• Beyond Subtitles: Captioning and Visualizing Non-speech Sounds to Improve Accessibility of User-Generated Videos

  Oliver Alonzo, Hijung Valentina Shin, Dingzeyu Li · 2022 · Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This paper investigates a significant gap in video captioning: the representation of non-speech sounds. While automatic speech recognition (ASR) has become widely available for generating captions on platforms like YouTube, TikTok, and Zoom, these systems focus exclusively on…

  deaf and hard of hearing · captioning · non-speech sounds · automatic captions · video accessibility

• Watch It, Don't Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper builds a better automated metric for the severity of caption-occlusion — the problem of closed captions blocking important on-screen visual content during television programming. DHH viewers consistently report that even perfectly transcribed captions become…

  captioning · captions · caption occlusion · deaf and hard of hearing · television accessibility

• Effect of Caption Width on the TV User Experience by Deaf and Hard of Hearing Viewers

  Abraham Glasser, Joseline Garcia, Chang Hwang, Christian Vogler, Raja Kushalnagar · 2021 · Proceedings of the 18th International Web for All Conference (W4A)

  This study from Rochester Institute of Technology and Gallaudet University investigates how caption line width affects the viewing experience for Deaf and hard of hearing (DHH) viewers. Captioning technology has not kept pace with the shift from broadcast TV to diverse personal…

  captioning · deaf and hard of hearing · video accessibility · user experience · media accessibility

• Slidecho: Flexible Non-Visual Exploration of Presentation Videos

  Yi-Hao Peng, Jeffrey P Bigham, Amy Pavel · 2021 · Proceedings of the 23rd International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '21)

  This paper presents Slidecho, a system that makes recorded presentation videos accessible to blind and visually impaired learners by automatically extracting slide content and synchronizing it with the presenter's speech. The core problem is that most presentation videos —…

  video accessibility · blind and low vision · audio description · presentations · screen reader

• The Efficacy of Collaborative Authoring of Video Scene Descriptions

  Rosiana Natalie, Jolene Loh, Huei Suen Tan, Joshua Tseng, Ian Luke Yi-Ren Chan, Ebrima H Jarjue, Hernisa Kacorri, Kotaro Hara · 2021 · ASSETS '21: The 23rd International ACM SIGACCESS Conference on Computers and Accessibility

  The vast majority of online video content remains inaccessible to people with visual impairments because it lacks audio descriptions — verbal commentaries that depict visual information in scenes. Professional audio description services cost US$12 to US$75 per video minute and…

  audio description · video accessibility · visual impairment · crowdsourcing · collaborative authoring

• Deaf and Hard-of-hearing Users Evaluating Designs for Highlighting Key Words in Educational Lecture Videos

  Sushant Kafle, Becca Dingman, Matt Huenerfauth · 2021 · ACM Transactions on Accessible Computing

  This empirical study investigates design preferences for keyword highlighting in video captions among Deaf and Hard of Hearing (DHH) users. While style guides like the APA Publication Manual and Chicago Manual of Style provide recommendations for highlighting text in static…

  deaf and hard of hearing · captions · captioning · video accessibility · text highlighting

• A Saliency-Driven Video Magnifier for People with Low Vision

  Ali Selman Aydin, Shirin Feiz, Vikas Ashok, I V Ramakrishnan · 2020 · Proceedings of the 17th International Web for All Conference (W4A)

  This demonstration paper presents SViM (Saliency-driven Video Magnifier), a system that uses deep learning-based visual saliency prediction to automatically guide screen magnification to the most important regions of a video for people with low vision. Screen magnifiers are the…

  low vision · screen magnifier · video accessibility · computer vision · deep learning

• Deaf and hard-of-hearing users’ prioritization of genres of online video content requiring accurate captions

  Larwan Berke, Matthew Seita, Matt Huenerfauth · 2020 · Proceedings of the 17th International Web for All Conference (W4A)

  This paper investigates which genres of online video content Deaf and Hard-of-Hearing (DHH) users consider most important to have accurately captioned. With over 400 hours of video uploaded to YouTube every minute and no U.S. legal mandate to caption all online video (especially…

  deaf and hard of hearing · captioning · video accessibility · automatic speech recognition · user research

• Rescribe: Authoring and Automatically Editing Audio Descriptions

  Amy Pavel, Gabriel Reyes, Jeffrey P. Bigham · 2020 · Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST '20)

  This paper introduces Rescribe, a tool that helps authors create and refine audio descriptions for videos. Audio descriptions make video content accessible to blind and visually impaired viewers by narrating important visual information during gaps in the existing audio track. A…

  audio description · video accessibility · blind and low vision · NLP · sentence compression

• Evaluating the Benefit of Highlighting Key Words in Captions for People who are Deaf or Hard of Hearing

  Sushant Kafle, Peter Yeung, Matt Huenerfauth · 2019 · Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper investigates whether visually highlighting important words in video captions benefits Deaf and Hard of Hearing (DHH) users, through formative studies and a larger evaluation study. DHH users face a unique visual-attention challenge when watching captioned video: they…

  Deaf and hard of hearing · captioning · text highlighting · educational accessibility · video accessibility

• Automatic Natural Language Generation Applied to Alternative and Augmentative Communication for Online Video Content Services using SimpleNLG for Spanish

  Silvia García-Méndez, Milagros Fernández-Gavilanes, Enrique Costa-Montenegro, Jonathan Juncal-Martínez, Francisco Javier González-Castaño · 2018 · Proceedings of the 15th International Web for All Conference (W4A 2018)

  This short paper presents the development of a Spanish version of SimpleNLG — a natural language generation (NLG) library — specifically enhanced for Augmentative and Alternative Communication (AAC) applications. The work addresses a gap at the intersection of AAC and online…

  AAC · natural language processing · pictograms · Spanish · natural language generation

• Multi-view Mouth Renderization for Assisting Lip-reading

  Andrea Britto Mattos, Dario Augusto Borges Oliveira · 2018 · Proceedings of the 15th International Web for All Conference (W4A)

  This paper presents an assistive tool that uses Generative Adversarial Networks (GANs) to enhance video for people who rely on lip-reading. The core problem is that lip-readers generally prefer a frontal view of a speaker's face, but in real-world video the speaker may be…

  lip-reading · hearing impairment · Deaf and hard of hearing · deep learning · generative adversarial networks

• Closed ASL Interpreting for Online Videos

  Raja Kushalnagar, Matthew Seita, Abraham Glasser · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

  This paper introduces "closed interpreting," a concept analogous to closed captioning but for sign language interpretation of online videos. While many deaf viewers prefer ASL interpreters over captions (as verbatim captioning speed often exceeds reading abilities, and deaf…

  American Sign Language · ASL · Deaf and hard of hearing · sign language interpreting · video accessibility

• Speed-Accuracy Tradeoffs for Detecting Sign Language Content in Video Sharing Sites

  Frank M. Shipman, Satyakiran Duggina, Caio D.D. Monteiro, Ricardo Gutierrez-Osuna · 2017 · Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper addresses the problem of automatically detecting sign language content in videos on sharing platforms like YouTube and Vimeo. For many deaf and hard-of-hearing people, sign language is their primary communication medium, and they rely on online video content to stay…

  sign language · computer vision · video classification · information retrieval · deaf and hard of hearing

• Leveraging Complementary Contributions of Different Workers for Efficient Crowdsourcing of Video Captions

  Yun Huang, Yifeng Huang, Na Xue, Jeffrey P. Bigham · 2017 · CHI Conference on Human Factors in Computing Systems

  This paper presents BandCaption, a crowdsourcing system that combines automatic speech recognition (ASR) with input from diverse crowd workers to efficiently correct video captions. The key insight is that different groups of people — hearing-impaired users, second-language…

  captioning · crowdsourcing · video accessibility · speech recognition · deaf and hard of hearing

• Accessible OzPlayer Video Player

  Matt McLeod, Gian Wild · 2016 · Proceedings of the 13th International Web for All Conference (W4A)

  This extended abstract presents OzPlayer, a web video player built by Australian accessibility consultancy AccessibilityOz specifically to address the widespread inaccessibility of popular video players on the web. The authors, who routinely audited client websites, found that…

  video accessibility · media accessibility · keyboard accessibility · captions · audio description

• HTML5 accessible video player: how and why

  Crista Earl, Elizabeth Neal · 2016 · Proceedings of the 13th International Web for All Conference (W4A)

  This paper from the American Foundation for the Blind (AFB) describes the development of a free, open source HTML5 video player designed to address the widespread accessibility barriers in online video playback interfaces. The authors identify four key problems with existing…

  video accessibility · media accessibility · HTML5 · keyboard accessibility · low vision

• Closed ASL Interpreting for Online Videos

  Matthew Seita · 2016 · ASSETS '16: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces "closed interpreting"—a concept analogous to closed captions where an ASL interpreter video can be toggled on and customized alongside online video content. The motivation is straightforward but often overlooked: many deaf and hard of hearing people rely on…

  deaf and hard of hearing · American Sign Language · video accessibility · closed interpreting · multimedia accessibility

• Responsive Design for Personalised Subtitles

  Chris J. Hughes, Mike Armstrong, Rhianne Jones, Michael Crabb · 2015 · Proceedings of the 12th International Web for All Conference (W4A)

  This paper from BBC R&D and the University of Dundee proposes applying responsive web design principles to subtitle display, moving away from the legacy Teletext format that has constrained subtitling since 1979. Traditional subtitles are pre-blocked into fixed 38-character-wide…

  subtitles · captions · responsive design · video accessibility · personalization

• Online News Videos: The UX of Subtitle Position

  Michael Crabb, Rhianne Jones, Mike Armstrong, Chris J. Hughes · 2015 · ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This BBC-funded research investigates whether repositioning subtitles from their traditional placement within a video to below the video frame improves user experience for online news content. The study addresses a gap in captioning research: while television subtitling has…

  subtitles · captions · deaf accessibility · user experience · video accessibility

• AVD-LV: An Accessible Player for Captioned STEM Videos

  Raja S. Kushalnagar, John J. Rivera, Warrance Yu, Daniel S. Steed · 2014 · ASSETS '14: Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility

  This demo paper presents AVD-LV (Accessible View Device interface for Low Vision), a Chrome browser extension that enhances YouTube lecture video accessibility for deaf and low vision (DLV) viewers. The core problem is that captioned videos require DLV viewers to process two…

  deaf · low vision · captions · video accessibility · STEM education

• Towards the Usage of Pauses in Audio-Described Videos

  Benoît Encelle, Magali Ollagnier Beldame, Yannick Prié · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper explores the use of "artificial pauses" — brief interruptions inserted into video playback — as a technique for delivering audio descriptions that cannot fit within the natural gaps in a video's soundtrack. Classical audio description is constrained by the duration of…

  audio description · video accessibility · blindness · visual impairment · multimedia accessibility

• Captions Versus Transcripts for Online Video Content

  Raja S. Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper investigates a fundamental challenge for deaf and hard of hearing (DHH) users consuming online video: while hearing viewers can watch and listen simultaneously using separate sensory channels, DHH viewers must process two competing visual streams — the video content…

  captioning · deaf accessibility · transcripts · online education · MOOCs

• Enhancing Learning Accessibility through Fully Automatic Captioning

  Maria Federico, Marco Furini · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper proposes an architecture for automatically generating synchronized captions for video lectures using off-the-shelf automatic speech recognition (ASR) software, aimed at making educational content accessible to hearing impaired students, dyslexic students, ESL (English…

  captioning · speech recognition · education accessibility · deaf and hard of hearing · automatic speech recognition

• An Adaptive Videos Enrichment System Based on Decision Trees for People with Sensory Disabilities

  José Francisco Saray Villamizar, Benoît Encelle, Yannick Prié, Pierre-Antoine Champin · 2011 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper from the ACAV (Collaborative Annotation for Video Accessibility) project at the University of Lyon proposes an adaptive system that personalises how video accessibility descriptions are presented to users with sensory disabilities. The core insight is that predefined,…

  video accessibility · multimedia accessibility · machine learning · personalization · adaptive systems