MusA: Artwork Accessibility through Augmented Reality for People with Low Vision
Dragan Ahmetovic, Cristian Bernareggi, Kristian Keller, Sergio Mascetti · 2021 · Proceedings of the 18th International Web for All Conference (W4A) · doi:10.1145/3430263.3452441
Summary
This paper presents MusA (Museo Accessibile), an iOS mobile application that uses augmented reality to make 2D visual artworks in museums accessible to people with low vision. The research addresses the persistent problem that people with visual impairments rarely visit museums, partly due to difficulties accessing artwork content. Existing solutions such as tactile reproductions, audio guides, and specialized tours each have significant limitations: tactile reproductions are designed primarily for blind users and are placed in separate rooms away from the originals, audio guides are verbose and non-interactive, and specialized tours are not inclusive of other visitors. MusA builds on the DescriVedendo methodology, a structured approach to creating morphological artwork descriptions developed by an Italian non-profit organization working with people with visual impairments. The app uses image recognition to detect when a user frames a painting with their device camera, then presents the DescriVedendo description organized into navigable chapters, each corresponding to a different area of the artwork. In AR mode, visual overlays highlight the region being described with high-contrast contours superimposed on the real artwork. A virtual mode was added after the first iteration to address fatigue from holding the device pointed at the artwork, allowing users to interact with a captured image on screen instead. The system was developed through two iterative design cycles involving end-users with low vision at the Pinacoteca di Brera in Milan, one of Italy's most important art museums.
Key findings
Across both evaluation rounds with a total of 11 participants with low vision, MusA demonstrated strong usability and engagement. In the second iteration, MusA achieved an average System Usability Scale score of 92, compared to 95 for a traditional audio guide baseline — both rated "Excellent." Critically, MusA scored higher on questions about frequency of use and user confidence, and participants reported they would visit museums more frequently if MusA were available. The AR visual overlays were found useful by most participants, though those with the most severe visual impairments (closest to legal blindness) found the contrast insufficient even after improvements in the second iteration. Camera framing of artworks was easy for all participants, especially after vibro-haptic feedback was added to confirm artwork detection. The virtual mode successfully eliminated the fatigue problem reported in the first study, where participants grew tired holding their device pointed at paintings. Description navigation was rated easier in MusA than in the audio guide, and participants appreciated the freedom to explore artworks at their own pace rather than following a linear audio sequence.
Relevance
This research demonstrates that augmented reality can be a viable and even preferable alternative to traditional audio guides for museum visitors with low vision, a population whose needs are often overlooked in favor of solutions designed for blind users. The iterative, user-centered design process yielded practical insights: the importance of multimodal feedback (audio plus vibro-haptic confirmation), the need for high-contrast AR overlays adaptable to different artworks and lighting conditions, and the value of a virtual mode to reduce physical fatigue. For accessibility practitioners, the study highlights that people with low vision can and do interact with visual AR content, contrary to assumptions that AR is only useful for fully sighted users. The finding that MusA increased participants' stated intention to visit museums underscores how appropriate assistive technology can expand cultural participation. Limitations include the small sample size and the second study being conducted remotely during COVID-19 lockdowns rather than in the museum.
Tags: low vision · augmented reality · museum accessibility · art accessibility · mobile accessibility · assistive technology · user-centered design
Standards referenced: UNCRPD Article 30 · ADA