SoundNarratives: Rich Auditory Scene Descriptions to Support Deaf and Hard of Hearing People
Liang-Yuan Wu, Dhruv Jain · 2025 · ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility
This paper introduces SoundNarratives, a real-time system that generates rich, contextual auditory scene descriptions tailored to deaf and hard of hearing (DHH) users. Existing sound recognition technologies typically classify sounds into predefined categories like "door…
deaf and hard of hearing · sound awareness · generative AI · audio-language models · prompt engineering