Reviews

Search results

• Towards Automated Accessibility Report Generation for Mobile Apps

  Amanda Swearngin, Jason Wu, Xiaoyi Zhang, Esteban Gomez, Jen Coughenour, Rachel Stukenborg, Bhavya Garg, Greg Hughes, Adriana Hilliard, Jeffrey P. Bigham, Jeffrey Nichols · 2024 · ACM Transactions on Computer-Human Interaction

  This paper presents a system for automatically generating whole-app accessibility reports for mobile apps, addressing key limitations of existing accessibility scanning tools. The work begins with formative interviews with eight accessibility QA professionals at a large…

  automated testing · accessibility testing · mobile accessibility · app crawling · machine learning

• WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics

  Jason Wu, Siyan Wang, Siman Shen, Yi-Hao Peng, Jeffrey Nichols, Jeffrey P. Bigham · 2023 · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

  This paper introduces WebUI, a large-scale dataset of approximately 400,000 web pages automatically crawled and paired with visual, semantic, and stylistic metadata extracted from the browser engine. The dataset addresses a critical bottleneck in UI understanding research:…

  machine learning · computer vision · UI modeling · web semantics · transfer learning

• Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots

  Jason Wu, Xiaoyi Zhang, Jeff Nichols, Jeffrey P. Bigham · 2021 · The 34th Annual ACM Symposium on User Interface Software and Technology (UIST)

  This paper introduces screen parsing, the task of predicting UI elements and their hierarchical relationships from a screenshot alone. While prior work could detect individual UI elements on a screen (element detection), those approaches produced flat lists of elements with no…

  screen readers · mobile accessibility · computer vision · UI semantics · machine learning

• Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels

  Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White, Kyle Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, Aaron Everitt, Jeffrey P. Bigham · 2021 · CHI Conference on Human Factors in Computing Systems

  This paper from Apple introduces Screen Recognition, a system that automatically generates accessibility metadata for mobile apps by analyzing their visual pixels, enabling screen readers to work with apps that lack proper developer-provided accessibility information. The…

  mobile accessibility · screen readers · machine learning · object detection · VoiceOver

• One World, One Web ... But Great Diversity

  Brian Kelly, Liddy Nevile, EA Draffan, Sotiris Fanou · 2008 · Proceedings of the 2008 International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This provocative paper challenges the dominant WAI/WCAG-centric model of web accessibility, arguing that its narrow focus on guideline conformance of individual digital resources fails to account for the diversity of user needs, contexts of use, and the realities of Web 2.0…

  WCAG · accessibility policy · social model of disability · learning disabilities · Web 2.0

5 results.