Reviews

Search results

• Introducing Game Elements in Crowdsourced Video Captioning by Non-Experts

  Hernisa Kacorri, Kaoru Shinkawa, Shin Saito · 2014 · Proceedings of the 11th Web for All Conference (W4A)

  This paper from CUNY Graduate Center and IBM Research Tokyo presents a gamified crowdsourcing platform for video captioning that combines ASR output with non-expert human transcription to improve caption accuracy without monetary rewards. The system builds on the Collaborative…

  captioning · crowdsourcing · deaf and hard of hearing · gamification · automatic speech recognition

• Helping students keep up with real-time captions by pausing and highlighting

  Walter S. Lasecki, Raja Kushalnagar, Jeffrey P. Bigham · 2014 · Proceedings of the 11th Web for All Conference (W4A)

  This paper addresses a fundamental problem with real-time captioning for deaf and hard of hearing (DHH) students: the mismatch between speaking rates (approximately 170 words per minute) and reading rates, which causes students to fall progressively behind the live content. The…

  deaf and hard of hearing · captioning · real-time captioning · education · inclusive classrooms

• Accessibility Evaluation of Classroom Captions

  Raja S. Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham · 2014 · ACM Transactions on Accessible Computing

  This paper presents a comprehensive evaluation of real-time captioning approaches for classroom lectures, comparing Communication Access Realtime Translation (CART), Automatic Speech Recognition (ASR), and a novel collaborative captioning system called Legion:Scribe. The authors…

  real-time captioning · deaf and hard of hearing · classroom accessibility · crowdsourcing · eye tracking

• Identifying Sign Language Videos in Video Sharing Sites

  Frank M. Shipman, Ricardo Gutierrez-Osuna, Caio D. D. Monteiro · 2014 · ACM Transactions on Accessible Computing

  This paper addresses the challenge of finding sign language videos within general video sharing platforms like YouTube. While these platforms contain growing libraries of sign language content created by deaf community members, locating this content is difficult because…

  sign language · ASL · video classification · machine learning · computer vision

• Enhancing Caption Accessibility through Simultaneous Multimodal Information: Visual-Tactile Captions

  Raja S. Kushalnagar, Gary W. Behm, Joseph S. Stanislow, Vasu Gupta · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS)

  This paper addresses a fundamental limitation of captions (subtitles) for deaf and hard of hearing (DHH) viewers: captions force viewers to split attention between reading text at the bottom of the screen and watching the visual action, inevitably causing them to miss…

  captioning · deaf and hard of hearing · haptic feedback · multimodal interaction · non-speech information

• Real-Time Caption Challenge: C-Print

  Michael S. Stinson, Pamela Francis, Lisa B. Elliot, Donna Easton · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14)

  This demonstration paper presents C-Print, a typing-based real-time captioning system developed over 25 years by researchers at the National Technical Institute for the Deaf (NTID) at Rochester Institute of Technology. C-Print provides communication access for deaf and hard of…

  deaf and hard of hearing · real-time captioning · communication access · transcription · mobile accessibility

• Real-Time Captioning with the Crowd

  Walter S. Lasecki, Jeffrey P. Bigham · 2014 · Interactions

  This article presents Scribe, a crowdsourced real-time captioning system that allows groups of non-expert typists to collectively produce captions at the speed of natural speech — a task that normally requires highly trained professional stenographers. The authors motivate the…

  real-time captioning · crowdsourcing · deaf and hard of hearing · speech-to-text · human computation

• Legion Scribe: Real-Time Captioning by Non-Experts

  Walter S. Lasecki, Raja Kushalnagar, Jeffrey P. Bigham · 2014 · ACM SIGACCESS Conference on Computers and Accessibility

  This demonstration paper presents Legion:Scribe, a crowd-powered captioning system that enables groups of 3-5 non-expert typists to collectively produce real-time captions with less than 5 seconds of latency. The system addresses the prohibitive cost of professional…

  real-time captioning · crowdsourcing · deaf and hard of hearing · speech-to-text · human computation

• Implementation and Evaluation of Animation Controls Sufficient for Conveying ASL Facial Expressions

  Hernisa Kacorri, Matt Huenerfauth · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14)

  This ASSETS 2014 short paper (2 pages) reports an infrastructure contribution to sign-language-animation research: the authors extended an existing virtual human character (Max, on the open-source EMBR animation platform) with a full set of MPEG-4 Facial Action Parameter (FAP)…

  american sign language · sign language animation · signing avatar · deaf and hard of hearing · facial expression

9 results.