Reviews

Search results

• AdaptiveSound: An Interactive Feedback-Loop System to Improve Sound Recognition for Deaf and Hard of Hearing Users

  Hang Do, Quan Dang, Jeremy Zhengqi Huang, Dhruv Jain · 2023 · ASSETS '23: Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces AdaptiveSound, the first feedback-loop sound recognition system designed for deaf and hard of hearing (DHH) users. Sound recognition tools help DHH people become aware of environmental sounds ranging from safety-critical alerts like fire alarms and sirens…

  deaf and hard of hearing · sound recognition · human-in-the-loop · machine learning · incremental learning

• "Not There Yet": Feasibility and Challenges of Mobile Sound Recognition to Support Deaf and Hard-of-Hearing People

  Jeremy Zhengqi Huang, Hriday Chhabria, Dhruv Jain · 2023 · Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS)

  This paper presents the first longitudinal field study of a mobile sound recognition system used by Deaf and hard of hearing (DHH) people in their daily lives. The researchers deployed SoundWatch, a smartwatch-based app that uses a deep learning model (Google YAMNet…

  deaf and hard of hearing · sound recognition · wearable technology · smartwatch · assistive technology

• Technical Perspective: Computation Where the (Inter)Action Is

  Jeffrey P. Bigham · 2022 · Communications of the ACM

  This one-page technical perspective accompanies the SoundWatch paper in Communications of the ACM. Bigham uses SoundWatch — a smartwatch prototype that detects audio events and displays descriptions for deaf and hard-of-hearing people — as a lens to explore broader questions…

  wearable technology · deaf and hard of hearing · sound recognition · smartwatch · assistive technology

• Automated Class Discovery and One-Shot Interactions for Acoustic Activity Recognition

  Jason Wu, Chris Harrison, Jeffrey P. Bigham, Gierad Laput · 2020 · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20)

  This paper presents Listen Learner, an end-to-end system for acoustic activity recognition that automatically discovers and learns to classify environmental sounds with minimal user effort. Traditional approaches to sound recognition face a tradeoff: custom models trained in a…

  acoustic activity recognition · smart home · machine learning · Internet of Things · context awareness

• Visualizing Non-Speech Sounds for the Deaf

  Tara Matthews, Janette Fong, Jennifer Mankoff · 2005 · Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '05)

  This paper investigates peripheral visual displays that help people who are deaf maintain awareness of non-speech sounds in their environment — sounds like phone ringing, doorbells, knocking, fire alarms, children playing, dogs barking, and appliances operating. While commercial…

  deaf accessibility · sound visualization · peripheral display · sound recognition · ambient display

5 results.