UIClip: A Data-driven Model for Assessing User Interface Design
Jason Wu, Yi-Hao Peng, Xin Yue Amanda Li, Amanda Swearngin, Jeffrey P. Bigham, Jeffrey Nichols · 2024 · Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST '24)
This paper introduces UIClip, a computational model that automatically assesses UI design quality and visual relevance from a screenshot and natural language description. Built on OpenAI's CLIP B/32 architecture (151 million parameters), UIClip is fine-tuned on a novel…
UI design · machine learning · design quality assessment · computer vision · CLIP