Reviews

Search results

• A TensorFlow-based Assistive Technology System for Users with Visual Impairments

  Davide Mulfari · 2018 · Proceedings of the 15th International Web for All Conference (W4A 2018)

  This extended abstract presents a wearable computer vision system that uses deep learning to classify objects in a blind user’s surroundings and provide audio descriptions via text-to-speech. The system addresses a limitation of smartphone-based object recognition apps: people…

  computer vision · deep learning · blind · visual impairment · wearable technology

• Accessify: An ML Powered Application to Provide Accessible Images on Web Sites

  Shivam Singh, Anurag Bhandari, Nishith Pathak · 2018 · Proceedings of the 15th International Web for All Conference (W4A 2018)

  This demonstration paper presents Accessify, a browser plugin that uses machine learning to automatically generate alternative text descriptions for all images on a website, injecting them into the page’s DOM so screen readers can access them. The system addresses the persistent…

  alternative text · image accessibility · machine learning · browser extension · computer vision

• Multi-view Mouth Renderization for Assisting Lip-reading

  Andrea Britto Mattos, Dario Augusto Borges Oliveira · 2018 · Proceedings of the 15th International Web for All Conference (W4A)

  This paper presents an assistive tool that uses Generative Adversarial Networks (GANs) to enhance video for people who rely on lip-reading. The core problem is that lip-readers generally prefer a frontal view of a speaker's face, but in real-world video the speaker may be…

  lip-reading · hearing impairment · Deaf and hard of hearing · deep learning · generative adversarial networks

• Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World

  Anhong Guo, Saige McVea, Xu Wang, Patrick Clary, Ken Goldman, Yang Li, Yu Zhong, Jeffrey P. Bigham · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018)

  This paper from Google and Carnegie Mellon University defines and compares three cursor-based interaction techniques designed to help blind and low vision people attend to specific items within complex real-world visual scenes. While computer vision systems like Seeing AI and…

  blindness · low vision · computer vision · non-visual exploration · mobile accessibility

• BrowseWithMe: An Online Clothes Shopping Assistant for People with Visual Impairments

  Abigale J. Stangl, Esha Kothari, Suyog D. Jain, Tom Yeh, Kristen Grauman, Danna Gurari · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018)

  This paper from the University of Colorado Boulder and University of Texas at Austin addresses the inaccessibility of online clothes shopping for people with visual impairments through both empirical investigation and a prototype AI-powered assistant called BrowseWithMe. The…

  blindness · low vision · web accessibility · online shopping · computer vision

• A Demo of Talkit++: Interacting with 3D Printed Models Using an iOS Device

  Lei Shi, Zhuohao Zhang, Shiri Azenkot · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018)

  This Cornell Tech demo presents Talkit++, an iOS application that adds interactive multimedia labels to 3D printed tactile models for visually impaired students. Teachers of the visually impaired (TVIs) increasingly use 3D printers to create tactile learning materials, but these…

  blindness · low vision · 3D printing · tactile accessibility · computer vision

• Exploring the Performance of Facial Expression Recognition Technologies on Deaf Adults and Their Children

  Irene Rogan Shaffer · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018)

  This Boston University student research paper investigates how commercial facial expression recognition services perform on Deaf ASL signers and Children of Deaf Adults (CODAs) compared to hearing non-signers. The study is motivated by a critical problem: in ASL and other sign…

  deaf and hard of hearing · sign language · facial expression recognition · emotion recognition · AI fairness

• Crowd-AI Camera Sensing in the Real World

  Anhong Guo, Anuraag Jain, Shomiron Ghose, Gierad Laput, Chris Harrison, Jeffrey P. Bigham · 2018 · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

  This paper presents Zensors++, a hybrid crowd-AI camera sensing system that allows users to point a networked camera at a scene, define a natural language question about it (such as "Is the coffee machine in use?" or "How many people are in the room?"), and receive continuous,…

  crowdsourcing · computer vision · human computation · machine learning · smart environments

8 results.