← Writing · Glossary →

Reviews

The literature-review database. Every paper Bob has reviewed (he has read many more), with a short summary, key findings, and tags. Browse, filter, search.

Filter

Tag

Search results

  • Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots

    Jason Wu, Xiaoyi Zhang, Jeff Nichols, Jeffrey P. Bigham · 2021 · The 34th Annual ACM Symposium on User Interface Software and Technology (UIST)

    This paper introduces screen parsing, the task of predicting UI elements and their hierarchical relationships from a screenshot alone. While prior work could detect individual UI elements on a screen (element detection), those approaches produced flat lists of elements with no…

    screen readers · mobile accessibility · computer vision · UI semantics · machine learning

  • Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels

    Xiaoyi Zhang, Lilian de Greef, Amanda Swearngin, Samuel White, Kyle Murray, Lisa Yu, Qi Shan, Jeffrey Nichols, Jason Wu, Chris Fleizach, Aaron Everitt, Jeffrey P. Bigham · 2021 · CHI Conference on Human Factors in Computing Systems

    This paper from Apple introduces Screen Recognition, a system that automatically generates accessibility metadata for mobile apps by analyzing their visual pixels, enabling screen readers to work with apps that lack proper developer-provided accessibility information. The…

    mobile accessibility · screen readers · machine learning · object detection · VoiceOver

2 results.