Reviews

Search results

• Exploring the Role of Social Support When Integrating Generative AI in Small Business Workflows

  Quentin Romero Lauro, Jeffrey P. Bigham, Yasmine Kotturi · 2024 · Companion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing (CSCW Companion '24)

  This paper investigates how small business owners from resource-constrained communities leverage their offline social networks to integrate generative AI technologies into their business workflows. The researchers interviewed 11 participants — seven entrepreneurs and four…

  generative AI · entrepreneurship · social support · technology adoption · digital divide

• UIClip: A Data-driven Model for Assessing User Interface Design

  Jason Wu, Yi-Hao Peng, Xin Yue Amanda Li, Amanda Swearngin, Jeffrey P. Bigham, Jeffrey Nichols · 2024 · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST '24)

  This paper introduces UIClip, a computational model that automatically assesses UI design quality and visual relevance from a screenshot and natural language description. Built on OpenAI's CLIP B/32 architecture (151 million parameters), UIClip is fine-tuned on a novel…

  UI design · machine learning · design quality assessment · computer vision · CLIP

• Towards Automated Accessibility Report Generation for Mobile Apps

  Amanda Swearngin, Jason Wu, Xiaoyi Zhang, Esteban Gomez, Jen Coughenour, Rachel Stukenborg, Bhavya Garg, Greg Hughes, Adriana Hilliard, Jeffrey P. Bigham, Jeffrey Nichols · 2024 · ACM Transactions on Computer-Human Interaction

  This paper presents a system for automatically generating whole-app accessibility reports for mobile apps, addressing key limitations of existing accessibility scanning tools. The work begins with formative interviews with eight accessibility QA professionals at a large…

  automated testing · accessibility testing · mobile accessibility · app crawling · machine learning

• "This really lets us see the entire world:" Designing a conversational telepresence robot for homebound older adults

  Yaxin Hu, Laura Stegner, Yasmine Kotturi, Caroline Zhang, Yi-Hao Peng, Faria Huq, Yuhang Zhao, Jeffrey P. Bigham, Bilge Mutlu · 2024 · Proceedings of the 2024 ACM Designing Interactive Systems Conference (DIS '24)

  This paper investigates how conversational telepresence robots can help homebound older adults interact with the external world. Homebound status — defined as rarely or never leaving home due to illness, injury, or environmental constraints — affects a growing proportion of…

  telepresence robots · older adults · homebound · social isolation · participatory design

• 'Your Duties Are To Sweep A Floor Remotely': Low Information Quality in Job Advertisements is a Barrier to Low-Income Job-Seekers' Successful Use of Digital Platforms

  Sara Kingsley, Michael Six Silberman, Clara Wang, Robert Lambeth, Jiayin Zhi, Motahhare Eslami, Beibei Li, Jeffrey Bigham · 2024 · Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work (CHIWORK)

  This paper investigates barriers that low-income job-seekers face when using digital platforms to find work, based on 27 semi-structured interviews with US residents earning under $45,000 who had searched for paid work in the previous two years. The participants — 30% of whom…

  digital inclusion · digital divide · employment · disability employment · low-income users

• COMPA: Using Conversation Context to Achieve Common Ground in AAC

  Stephanie Valencia, Jessica Huynh, Emma Y Jiang, Yufei Wu, Teresa Wan, Zixuan Zheng, Henny Admoni, Jeffrey P Bigham, Amy Pavel · 2024 · Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24)

  This paper presents COMPA, a browser extension add-on tool designed to help AAC (Augmentative and Alternative Communication) users and their conversation partners achieve common ground during online group conversations. The core problem is speed asymmetry: AAC users may take…

  AAC · augmentative and alternative communication · communication accessibility · group conversation · common ground

• BentoMuseum: 3D and Layered Interactive Museum Map for Blind Visitors

  Xiyue Wang, Seita Kayukawa, Hironobu Takagi, Chieko Asakawa · 2024 · Communications of the ACM

  BentoMuseum proposes a novel museum map format designed to help blind visitors access the multidimensional information of a complex, multi-floor museum before and during a visit. Unlike conventional tactile maps that depict a single floor layout and struggle to convey volumetric…

  museum accessibility · blindness and low vision · tactile map · audio-tactile interaction · 3D printing

• Snap&Nav: Smartphone-based Indoor Navigation System For Blind People via Floor Map Analysis and Intersection Detection

  Masaya Kubota, Masaki Kuribayashi, Seita Kayukawa, Hironobu Takagi, Chieko Asakawa, Shigeo Morishima · 2024 · Proceedings of the ACM on Human-Computer Interaction (MobileHCI)

  Snap&Nav is a smartphone-based indoor navigation system for blind travellers that works in any building with a visible floor map, without requiring the building owner to pre-build a digital map, install BLE beacons, or deploy any other localisation infrastructure. The authors…

  blindness and low vision · indoor navigation · wayfinding · map-less navigation · intersection detection

• ChitChatGuide: Conversational Interaction Using Large Language Models for Assisting People with Visual Impairments to Explore a Shopping Mall

  Yuka Kaniwa, Masaki Kuribayashi, Seita Kayukawa, Daisuke Sato, Hironobu Takagi, Chieko Asakawa, Shigeo Morishima · 2024 · Proceedings of the ACM on Human-Computer Interaction (MobileHCI)

  ChitChatGuide is a smartphone-based indoor navigation system that wraps a GPT-4-powered conversational interface around an existing BLE-beacon localisation stack (HULOP) to support something most blind-navigation research overlooks: casual, purpose-less exploration — the blind…

  blindness and low vision · large language model · indoor navigation · wayfinding · conversational agent

• Caption Royale: Exploring the Design Space of Affective Captions from the Perspective of Deaf and Hard-of-Hearing Individuals

  Caluã de Lacerda Pataca, Saad Hassan, Nathan Tinker, Roshan Lalintha Peiris, Matt Huenerfauth · 2024 · CHI '24: Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems

  This CHI 2024 paper from Rochester Institute of Technology and Tulane tackles a concrete design question: if we want captions to convey a speaker's emotion — not just their words — which typographic modulations should we use? Prior work had established that affective captions…

  captioning · affective captions · expressive captions · typography · valence

• What We Know About Digital Accessibility for People with Cognitive, Learning, and Neurological Disabilities

  Clayton Lewis · 2023 · ACM Computing Surveys

  A comprehensive review of research on digital accessibility for people with cognitive, learning, and neurological disabilities. Examines the gap between current standards (which focus primarily on sensory and motor disabilities) and the needs of this broader population.

  cognitive accessibility · inclusive design · research review

• A More Accessible Web with Natural Language Interface

  Xiang Deng · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This extended abstract proposes building a general natural language interface (NLI) for the Web that would allow users to express their needs in plain language and have the system automatically carry out the required actions on any website. The approach aims to reduce the…

  natural language processing · web accessibility · web automation · semantic parsing · large language models

• "Dump it, Destroy it, Send it to Data Heaven": Blind People's Expectations for Visual Privacy in Visual Assistance Technologies

  Abigale Stangl, Emma Sadjo, Pardis Emami-Naeini, Yang Wang, Danna Gurari, Leah Findlater · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates the visual privacy expectations of 16 totally blind individuals who use visual assistance technologies (VATs) such as Aira, Be My Eyes, Seeing AI, and Envision AI. VATs provide blind users access to visual information by connecting them to remote human…

  visual privacy · blind users · visual assistance technology · privacy expectations · data protection

• Ability + Motivation: Understanding Factors that Influence People with Cognitive Disabilities in Regularly Practicing Daily Activities

  Varsha Koushik, Shaun Kane · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates the factors that influence people with cognitive disabilities in regularly practicing daily activities, focusing on the interplay between ability and motivation. The researchers conducted 90-minute remote participatory design interviews with 13…

  cognitive accessibility · cognitive disabilities · daily living activities · prompting systems · smart home

• AutoChemplete - Making Chemical Structural Formulas Accessible

  Merlin Knaeble, Gabriel Sailer, Zihan Chen, Thorsten Schwarz, Kailun Yang, Mario Nadj, Rainer Stiefelhagen, Alexander Maedche · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper presents AutoChemplete, an interactive labeling tool that makes chemical structural formulas accessible to blind and low-vision (BLV) students. Chemical structural formulas — visual diagrams showing atoms, bonds, and molecular geometry — are fundamental to studying…

  STEM accessibility · blind and low vision · chemistry · machine learning · interactive labeling

• Amaze3D: Making 3D Worlds Accessible to Blind Gamers

  Greg Gay, Matthew Ralston · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This extended abstract presents Amaze3D (The Accessibility Maze 3D), a proof-of-concept demonstrating that Unity-based 3D game worlds can be made independently navigable by blind players. Built as a WebGL-based 3D adaptation of an earlier 2D JavaScript Accessibility Maze, the…

  game accessibility · blind users · Unity · 3D worlds · educational games

• Translating Color: Sonification as a Method of Sensory Substitution within the Museum

  Silvia Dini, Luca Andrea Ludovico, Sergio Mascetti, Maria Joaquina Valero Gisbert · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This extended abstract proposes using sonification — the technique of translating data into sound — to make the chromatic elements of contemporary artworks accessible to people with visual impairments or blindness (VIB). The research addresses a fundamental challenge in museum…

  sonification · museum accessibility · visual impairment · sensory substitution · art accessibility

• Authoring Web-accessible Mathematical Diagrams

  David Austin, Volker Sorge · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This extended abstract presents an XML-based authoring language for creating web-accessible mathematical diagrams, designed to integrate with PreTeXt, a tool for producing accessible scholarly documents. While text and mathematical formulas in LaTeX can be made web-accessible…

  STEM accessibility · mathematical diagrams · SVG accessibility · screen readers · sonification

• Modeling Word Importance in Conversational Transcripts: Toward improved live captioning for Deaf and hard of hearing viewers

  Akhter Al Amin, Saad Hassan, Matt Huenerfauth, Cecilia O. Alm · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates how to model word importance in conversational transcripts to improve live captioning quality for Deaf and hard of hearing (DHH) viewers. Live captions generated by automatic speech recognition (ASR) systems inevitably contain errors, but not all errors…

  live captioning · deaf and hard of hearing · automatic speech recognition · word importance · natural language processing

• AutoChemplete - Making Chemical Structural Formulas Accessible (Extended Abstract)

  Merlin Knaeble, Gabriel Sailer, Zihan Chen, Thorsten Schwarz, Kailun Yang, Mario Nadj, Rainer Stiefelhagen, Alexander Maedche · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This extended abstract presents AutoChemplete, an interactive labeling tool designed to make chemical structural formulas accessible to blind and low vision (BLV) students. The paper highlights a stark gap in STEM education: while 69% of US BLV students express interest in STEM…

  STEM accessibility · chemistry accessibility · blind and low vision · interactive labeling · machine learning

• UnlockedMaps: A Web-Based Map for Visualizing the Real-Time Accessibility of Urban Rail Transit Stations

  Ather Sharif, Aneesha Ramesh, Qianqian Yu, Trung-Anh H. Nguyen, Xuhai Xu · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper presents UnlockedMaps, an open-data web-based map that visualizes the real-time accessibility status of urban rail transit stations across six North American cities. The system addresses a critical gap: commuters who depend on functioning station elevators — including…

  transit accessibility · mobility disabilities · open data · web-based maps · urban accessibility

• Authoring Web-accessible Mathematical Diagrams (Short Paper)

  David Austin, Volker Sorge · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This short paper presents a novel XML-based language for authoring accessible mathematical diagrams, targeting both visually impaired (VI) and sighted authors. Mathematical diagrams are essential for STEM subjects yet remain overwhelmingly inaccessible in electronic documents —…

  STEM accessibility · mathematical diagrams · SVG accessibility · blind and low vision · sonification

• The State of Accessibility in Blackboard: Survey and User Reviews Case Study

  Wajdi Aljedaani, Mohammed Alkahtani, Stephanie Ludi, Mohamed Wiem Mkaouer, Marcelo M. Eler, Marouane Kessentini, Ali Ouni · 2023 · Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates the accessibility of the Blackboard mobile app, one of the most widely used Learning Management Systems (LMS) in higher education, through a two-pronged methodology. First, the authors conducted a large-scale survey with 1,308 hearing students and 65 deaf…

  mobile accessibility · learning management systems · deaf and hard of hearing · education accessibility · user reviews

• Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2023 · Proceedings of the 20th International Web for All Conference (W4A '23)

  This study investigates how Deaf and Hard of Hearing (DHH) viewers distribute their visual attention across different information regions on screen while watching captioned live television news. More than 360 million people worldwide are DHH, and many rely on captions to access…

  deaf and hard of hearing · captioning · eye tracking · television accessibility · caption placement

• Case Study: In-the-Field Accessibility Information Collection Using Gamification

  Akihiro Miyata, Kazuki Okugawa, Yusaku Murayama, Akihiro Furuta, Keihiro Ochiai, Yuko Murayama · 2023 · Proceedings of the 20th International Web for All Conference (W4A '23)

  This study introduces and evaluates a crowdsourcing platform designed to collect real-world accessibility information for constructing accessibility maps that support people with mobility disabilities. Accessibility maps are critical for safe navigation by wheelchair users and…

  crowdsourcing · gamification · accessible maps · physical accessibility · pedestrian infrastructure