Reviews

Search results

• Real-Time Crowd Labeling for Deployable Activity Recognition

  Walter S. Lasecki, Young Chol Song, Henry Kautz, Jeffrey P. Bigham · 2013 · Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW 2013)

  Legion:AR is a system that provides deployable activity recognition by combining real-time crowd labeling with automatic recognition using Hidden Markov Models (HMMs). The system addresses a critical limitation of current activity recognition: automated systems must be trained…

  activity recognition · crowdsourcing · human computation · machine learning · aging in place

• Answering Visual Questions with Conversational Crowd Assistants

  Walter S. Lasecki, Phyo Thiha, Yu Zhong, Erin Brady, Jeffrey P. Bigham · 2013 · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2013)

  This paper introduces Chorus:View, a system that enables blind users to get visual questions answered through continuous conversational interaction with multiple crowd workers viewing a live video stream from the user's mobile device. The system addresses key limitations of…

  blind and low vision · crowdsourcing · human computation · assistive technology · visual assistance

• Adaptive Time Windows for Real-Time Crowd Captioning

  Matthew J. Murphy, Christopher D. Miller, Walter S. Lasecki, Jeffrey P. Bigham · 2013 · CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

  This paper addresses a key barrier to real-time captioning access for deaf and hard of hearing people: the high cost of professional stenographers, who can charge up to $200 per hour. Building on the Legion:Scribe system, which demonstrated that groups of non-expert crowd…

  real-time captioning · crowdsourcing · deaf and hard of hearing · assistive technology · human computation

• Chorus: A Crowd-Powered Conversational Assistant

  Walter S. Lasecki, Rachel Wesley, Jeffrey Nichols, Anand Kulkarni, James F. Allen, Jeffrey P. Bigham · 2013 · UIST '13: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology

  This paper presents Chorus, a crowd-powered conversational assistant that enables users to hold natural, continuous conversations with what appears to be a single partner, but is actually backed by multiple crowd workers operating in real-time. The system addresses a fundamental…

  crowdsourcing · conversational assistants · human computation · dialog systems · real-time systems

• Visual Challenges in the Everyday Lives of Blind People

  Erin Brady, Meredith Ringel Morris, Yu Zhong, Samuel White, Jeffrey P. Bigham · 2013 · CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

  This paper presents the findings of a year-long large-scale study of VizWiz Social, an iPhone application that allows blind users to take a photograph, record a spoken question about it, and receive answers from crowd workers or social contacts within about a minute. Between May…

  blind users · crowdsourcing · mobile accessibility · VizWiz · visual question answering

• Crowd Caption Correction (CCC)

  Rebecca Perkins Harrington, Gregg C. Vanderheiden · 2013 · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '13)

  This short paper presents Crowd Caption Correction (CCC), a feature that allows meeting participants or authorized third parties to correct errors in real-time captions during telecollaboration sessions. Captions are critical for deaf and hard of hearing people to participate in…

  captioning · deaf and hard of hearing · crowdsourcing · telecollaboration · real-time captioning

• Improving Public Transit Accessibility for Blind Riders by Crowdsourcing Bus Stop Landmark Locations with Google Street View

  Kotaro Hara, Shiri Azenkot, Megan Campbell, Cynthia L. Bennett, Vicki Le, Sean Pannella, Robert Moore, Kelly Minckler, Rochelle H. Ng, Jon E. Froehlich · 2013 · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper introduces Bus Stop CSI (Crowdsourcing Streetview Inspections), a scalable method for collecting bus stop location and landmark descriptions by combining online crowdsourcing with Google Street View (GSV). Blind and low-vision bus riders rely heavily on physical…

  visual impairment · blindness · crowdsourcing · public transit · navigation

• IncluCity: Using Contextual Cues to Raise Awareness on Environmental Accessibility

  Jorge Goncalves, Vassilis Kostakos, Simo Hosio, Evangelos Karapanos, Olga Lyra · 2013 · Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper investigates whether contextual cues — specifically photographs and precise location information — can make accessibility awareness campaigns more effective at changing public attitudes toward disability and environmental barriers. Traditional campaigns often present…

  environmental accessibility · civic engagement · disability awareness · crowdsourcing · urban accessibility

• Alipi: A Framework for Re-Narrating Web Pages

  T. B. Dinesh, S. Uskudarli, Subramanya Sastry, Deepti Aggarwal, Venkatesh Choppella · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper introduces Alipi, a distributed and participatory framework for re-narrating web pages to make them more accessible to diverse audiences. The name "alipi" means "print illiterate" in Kannada and other Indian subcontinent languages, reflecting the project's origins in…

  social accessibility · web accessibility · crowdsourcing · localization · multilingual accessibility

• A Readability Evaluation of Real-Time Crowd Captions in the Classroom

  Raja S. Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham · 2012 · Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012)

  This paper evaluates the readability of real-time captions produced by three different approaches in a higher education classroom setting: professional CART (Communication Access Realtime Translation) captionists, automatic speech recognition (ASR), and a novel crowd captioning…

  real-time captioning · deaf and hard of hearing · crowdsourcing · classroom accessibility · higher education

• Using Real-time Feedback to Improve Visual Question Answering

  Yu Zhong, Phyo Thiha, Grant He, Walter Lasecki, Jeffrey Bigham · 2012 · CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

  This work-in-progress paper introduces Legion:View, a system that extends the VizWiz model of crowd-powered visual question answering by adding a real-time feedback loop between blind users and crowd workers. The original VizWiz allowed blind users to take a still photograph,…

  visual question answering · crowdsourcing · blind users · real-time systems · assistive technology

• Crowdsourcing Subjective Fashion Advice Using VizWiz: Challenges and Opportunities

  Michele A. Burton, Erin Brady, Robin Brewer, Callie Neylan, Jeffrey P. Bigham, Amy Hurst · 2012 · ASSETS '12: Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper investigates the accessibility barriers that fashion and clothing present to people with vision impairments, and explores whether crowdsourcing through VizWiz can provide useful subjective fashion advice. The research is grounded in the recognition that fashion is a…

  blind users · crowdsourcing · fashion accessibility · VizWiz · subjective questions

• Real-Time Captioning by Groups of Non-Experts

  Walter Lasecki, Christopher Miller, Adam Sadilek, Andrew Abumoussa, Donato Borrello, Raja Kushalnagar, Jeffrey Bigham · 2012 · UIST '12: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

  This paper presents Legion:Scribe, an end-to-end system that enables groups of non-expert typists to collectively produce real-time captions for deaf and hard of hearing (DHH) people, offering a cheaper and more available alternative to professional stenographers (CART, costing…

  real-time captioning · crowdsourcing · deaf and hard of hearing · human computation · text alignment

• Online Quality Control for Real-Time Crowd Captioning

  Walter S. Lasecki, Jeffrey P. Bigham · 2012 · Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012)

  This paper addresses quality control in Legion:Scribe, a system that provides real-time captioning by having multiple non-expert crowd workers simultaneously type what they hear, then automatically merging their partial transcriptions into a single caption stream. Real-time…

  real-time captioning · crowdsourcing · deaf and hard of hearing · automatic speech recognition · human computation

• Transforming Japanese Archives into Accessible Digital Books

  Tatsuya Ishihara, Toshinari Itoko, Daisuke Sato, Asaf Tzadok, Hironobu Takagi · 2012 · JCDL '12: Proceedings of the 12th ACM/IEEE-CS Joint Conference on Digital Libraries

  This JCDL 2012 paper from IBM Research Tokyo and Haifa tackles a problem that remained invisible in most English-focused digitisation work: producing fully accessible digital books from Japanese archives, where the writing system uses more than 10,000 characters (kanji plus…

  accessible ebooks · digitization · japanese · OCR · DAISY

• Crowdsourcing Correction of Speech Recognition Captioning Errors

  M. Wald · 2011 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper describes tools built around Synote, an award-winning web-based application from the University of Southampton, that enable crowdsourced correction of automatic speech recognition (ASR) captioning errors to make video content accessible at scale. The author frames the…

  captioning · speech recognition · crowdsourcing · deaf and hard of hearing · video accessibility

• Farfalla Project: Browser-Based Accessibility Solutions

  Andrea Mangiatordi, Harpreet Singh Sareen · 2011 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper presents Farfalla, a free and open-source project from the University of Milano Bicocca that provides cloud-based assistive technology through the browser, eliminating the need for locally installed software. The core insight is that traditional AT is deeply tied to…

  assistive technology · cloud computing · web accessibility · accessibility tools · browser extension

• What the Disability Community Can Teach Us About Interactive Crowdsourcing

  Jeffrey P. Bigham, Richard E. Ladner · 2011 · Interactions

  This short forum article argues that the disability community has been practicing interactive crowdsourcing long before the term became mainstream in computing, and that mainstream crowdsourcing systems have much to learn from these experiences. The authors trace how people with…

  crowdsourcing · assistive technology · disability community · visual question answering · sign language interpreting

• The Design of Human-Powered Access Technology

  Jeffrey P. Bigham, Richard E. Ladner, Yevgen Borodin · 2011 · Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2011)

  This paper presents a comprehensive framework of 13 design dimensions for evaluating and comparing human-powered access technology — systems that use human assistance, facilitated by technology, to overcome accessibility barriers that automation alone cannot solve. The authors…

  human computation · crowdsourcing · assistive technology · accessibility framework · design principles

• StopFinder: Improving the Experience of Blind Public Transit Riders with Crowdsourcing

  Sanjana Prasain · 2011 · The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This doctoral consortium paper presents StopFinder, a mobile system that uses crowdsourcing to collect and provide information about non-visual landmarks around bus stops for blind public transit riders. The research addresses a fundamental challenge: while people who are blind…

  blindness and low vision · crowdsourcing · navigation · public transportation · mobile accessibility

• Analyzing Visual Questions from Visually Impaired Users

  Erin L. Brady · 2011 · The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This doctoral consortium paper presents an analysis of the types of visual questions that visually impaired users ask through VizWiz, a mobile phone application that provides near-realtime answers to visual questions. VizWiz allows users to take a photo with their phone, speak a…

  blindness and low vision · crowdsourcing · computer vision · mobile accessibility · visual question answering

• VizWiz: Nearly Real-Time Answers to Visual Questions

  Jeffrey P. Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Robert C. Miller, Aubrey Tatarowicz, Brandyn White, Samuel White, Tom Yeh · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper introduces VizWiz, a pioneering mobile application that enables blind and low-vision people to get nearly real-time answers to visual questions by connecting their smartphone cameras to remote paid workers on Amazon Mechanical Turk. Users take a photo with their…

  blind and low vision · crowdsourcing · assistive technology · mobile accessibility · human computation

• Towards collaborative annotation for video accessibility

  Pierre-Antoine Champin, Benoît Encelle, Nicholas W. D. Evans, Magali O.-Beldame, Yannick Prié, Raphaël Troncy · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper presents the ACAV (Collaborative Annotation for Video Accessibility) project, a French research initiative involving Dailymotion, the University of Lyon (LIRIS), and EURECOM, aimed at making web video accessible to blind and deaf users through rich, collaborative…

  video accessibility · audio description · captioning · crowdsourcing · speech recognition

• Social accessibility: the challenge of improving web accessibility through collaboration

  Daisuke Sato, Masatomo Kobayashi, Hironobu Takagi, Chieko Asakawa · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper presents Social Accessibility, a collaborative project from IBM Research Tokyo that enlists volunteers to fix web accessibility problems reported by visually impaired users. The system works through a three-step process: blind users encounter and report accessibility…

  crowdsourcing · screen readers · alternative text · visual impairment · social computing

• Exploratory Analysis of Collaborative Web Accessibility Improvement

  Daisuke Sato, Hironobu Takagi, Masatomo Kobayashi, Shinya Kawanaka, Chieko Asakawa · 2010 · ACM Transactions on Accessible Computing

  This paper presents a detailed analysis of the Social Accessibility Project, an experimental crowdsourced service from IBM Research-Tokyo that enables volunteers to fix web accessibility problems without requiring site owners to modify their pages. Launched in July 2008, the…

  crowdsourcing · web accessibility · social computing · metadata · screen readers