Reviews

Search results

• Watch It, Don't Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth · 2022 · Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper builds a better automated metric for the severity of caption-occlusion — the problem of closed captions blocking important on-screen visual content during television programming. DHH viewers consistently report that even perfectly transcribed captions become…

  captioning · captions · caption occlusion · deaf and hard of hearing · television accessibility

• Reliability Aware Web Accessibility Experience Metric

  Shuyi Song, Jiajun Bu, Chengchao Shen, Andreas Artmeier, Zhi Yu, Qin Zhou · 2018 · Proceedings of the 15th International Web for All Conference (W4A)

  This paper introduces RA-WAEM (Reliability Aware Web Accessibility Experience Metric), a novel approach to measuring website accessibility that incorporates actual user experience from people with disabilities while accounting for the varying reliability of different evaluators.…

  accessibility metrics · user experience · accessibility evaluation · machine learning · web accessibility

• Usability Evaluation of Captions for People Who Are Deaf or Hard of Hearing

  Sushant Kafle, Matt Huenerfauth · 2018 · SIGACCESS Accessibility and Computing Newsletter (Issue 122)

  This is a SIGACCESS Newsletter article summarizing a line of research by Kafle and Huenerfauth on building a caption-quality evaluation metric that actually reflects the experience of Deaf and Hard-of-Hearing (DHH) readers — rather than simply counting speech-recognition errors.…

  automatic speech recognition · captioning · captions · caption quality · accessibility metrics

• Active Learning for Web Accessibility Evaluation

  Mengni Zhang, Can Wang, Zhi Yu, Chao Shen, Jiajun Bu · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

  This paper introduces "active-prediction," a semi-supervised machine learning method that addresses a fundamental bottleneck in web accessibility evaluation: the prohibitive cost of evaluating all pages in a large website. Current practice relies on sampling methods (ad hoc,…

  accessibility evaluation · machine learning · active learning · web accessibility · automated testing

• WAEM: A Web Accessibility Evaluation Metric Based on Partial User Experience Order

  Shuyi Song, Can Wang, Liangcheng Li, Zhi Yu, Xiao Lin, Jiajun Bu · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

  This paper introduces WAEM (Web Accessibility Experience Metric), a novel accessibility metric that derives checkpoint weights from actual user experience data rather than from WCAG priority levels. The authors demonstrate that existing metrics like WAB and WAQM, which weight…

  accessibility metrics · user experience · accessibility evaluation · machine learning · SVM

• An Optimal Sampling Method for Web Accessibility Quantitative Metric

  Mengni Zhang, Can Wang, Jiajun Bu, Zhi Yu, Yi Lu, Ruijie Zhang, Chun Chen · 2015 · Proceedings of the 12th International Web for All Conference (W4A 2015)

  This short paper proposes OPS-WAQM, an optimal page sampling method specifically designed for use with the Web Accessibility Quantitative Metric (WAQM) when evaluating large websites. The core problem is that evaluating every page of a large website for accessibility is…

  accessibility evaluation · sampling methods · accessibility metrics · WAQM · large-scale evaluation

• An analysis of personalized web accessibility

  Nádia Fernandes, Nikolaos Kaklanis, Konstantinos Votis, Dimitrios Tzovaras, Luís Carriço · 2014 · Proceedings of the 11th Web for All Conference (W4A)

  This paper presents an experimental study comparing generic (all-disabilities) web accessibility evaluations with personalized evaluations tailored to specific disability profiles. Using the WaaT (Web Accessibility Assessment Tool) evaluator, the authors assessed 39 home pages…

  accessibility testing · automated evaluation · personalization · accessibility metrics · WCAG compliance

• Web accessibility snapshot: an effort to reveal coding guidelines conformance

  Vagner Figueredo de Santana, Rogério Abreu de Paula · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper presents the first iteration of the Web Accessibility Snapshot (WAS) project, a large-scale automated evaluation of web accessibility conformance across two sets of 1,000 websites each: the Alexa top 1,000 most popular sites and a randomly generated sample of 1,000…

  automated testing · WCAG compliance · web accessibility · accessibility metrics · web standards

• A Challenge to Web Accessibility Metrics and Guidelines: Putting People and Processes First

  Martyn Cooper, David Sloan, Brian Kelly, Sarah Lewthwaite · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This influential paper argues that web accessibility is not an intrinsic property of a digital resource but a relational quality determined by the interaction between users, resources, and contexts — shaped by political, social, cultural, and technical factors. The authors…

  accessibility theory · accessibility policy · WCAG compliance · user experience · disability studies

• A Macroscopic Web Accessibility Evaluation at Different Processing Phases

  Nádia Fernandes, Luís Carriço · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper investigates a fundamental question about automated accessibility evaluation: does it matter whether you evaluate a web page as it arrives from the server (before browser processing) or as the user actually experiences it (after browser processing, including…

  automated testing · large-scale evaluation · web accessibility · browser processing · dynamic content

• Getting One Voice: Tuning Up Experts' Assessment in Measuring Accessibility

  Silvia Mirri, Paola Salomoni, Ludovico A. Muratori, Matteo Battistelli · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper addresses a fundamental challenge in web accessibility evaluation: how to reconcile the subjective assessments of multiple human experts into a single, reliable accessibility measurement. While automated testing tools produce binary pass/fail results for detectable…

  accessibility metrics · accessibility evaluation · manual evaluation · automated testing · expert assessment

• Prediction of Web Page Accessibility Based on Structural and Textual Features

  Sina Bahram, Debadeep Sen, Robert St. Amant · 2011 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper from NC State University explores whether machine learning classifiers can predict the accessibility of web pages based on structural and textual features of their DOM — features that are independent of explicit accessibility markup like alt text or ARIA attributes.…

  machine learning · accessibility evaluation · automated testing · visual impairment · web accessibility

• Web not for all: a large scale study of web accessibility

  Rui Lopes, Daniel Gomes, Luís Carriço · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper presents the first large-scale automated accessibility evaluation of nearly 30 million web pages from the Portuguese Web Archive. The researchers implemented 39 WCAG 1.0 checkpoints (priorities 1 and 2) based on the Unified Web Evaluation Methodology (UWEM) and…

  automated testing · accessibility evaluation · WCAG compliance · web science · accessibility metrics

• Analysis and integration of web accessibility metrics

  Maia Naftali · 2010 · Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This Google Student Award paper presents OceanAcc, a semi-automatic accessibility evaluation and analysis tool developed as a thesis project at the University of Buenos Aires. OceanAcc addresses a practical gap: while several accessibility metrics had been published in research…

  accessibility metrics · accessibility evaluation · automated testing · barrier walkthrough · WCAG compliance

• Quantitative Evaluation for Web Accessibility with Respect to Disabled Groups

  Pornpat Sirithumgul, Atiwong Suchato, Proadpran Punyabukkana · 2009 · Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper proposes a methodology for evaluating web accessibility that goes beyond standard WCAG conformance levels to assess suitability for specific disability groups, particularly vision-impaired and hearing-impaired users. The authors argue that WCAG conformance levels (A,…

  accessibility metrics · web accessibility · barrier walkthrough · quantitative evaluation · visual impairment

• Metrics for accessibility on the Vamolà project

  Silvia Mirri, Ludovico Antonio Muratori, Marco Roccetti, Paola Salomoni · 2009 · Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)

  This paper describes the Vamolà project (Italian acronym for "accessibility validator and monitor"), a collaboration between the University of Bologna and the Emilia Romagna Region that integrates an accessibility validator with a monitoring system designed to track…

  accessibility metrics · accessibility monitoring · automated testing · Stanca Act · accessibility evaluation

• The Impact of Accessibility Assessment in Macro Scale Universal Usability Studies of the Web

  Rui Lopes, Luís Carriço · 2008 · Proceedings of the 2008 International Cross-Disciplinary Conference on Web Accessibility (W4A 2008)

  This paper introduces Web Interaction Environments (WIEs), a modelling framework for studying universal usability of the web at large scale. The authors argue that existing approaches to accessibility evaluation treat audiences as homogeneous groups, failing to capture the…

  universal usability · audience modelling · web accessibility · WCAG evaluation · Wikipedia

• Quantitative Metrics for Measuring Web Accessibility

  Markel Vigo, Myriam Arrue, Giorgio Brajnik, Raffaella Lomuscio, Julio Abascal · 2007 · Proceedings of the 2007 International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper addresses a fundamental limitation of WCAG conformance levels (A, AA, AAA): they function as binary pass/fail thresholds that cannot distinguish between a site meeting all Priority 1 checkpoints and one meeting all Priority 1 plus nearly all Priority 2 checkpoints —…

  accessibility metrics · automated testing · accessibility evaluation · quality assurance · web accessibility monitoring

• Effects of sampling methods on web accessibility evaluations

  Giorgio Brajnik, Andrea Mulas, Claudia Pitton · 2007 · Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '07)

  Brajnik, Mulas, and Pitton's Assets '07 paper is a large, careful empirical investigation of the sampling step in web-accessibility evaluation — the step at which an evaluator picks which pages of a site to actually test. For any site above a trivial size, full coverage is…

  web accessibility · accessibility evaluation · sampling methods · accessibility metrics · conformance testing

• SAMBA: a semi-automatic method for measuring barriers of accessibility

  Giorgio Brajnik, Raffaella Lomuscio · 2007 · Proceedings of the 9th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '07)

  Brajnik and Lomuscio argue that web accessibility cannot be managed without being measured, yet existing accessibility metrics are underdeveloped and almost universally tied to conformance with WCAG checkpoints rather than to the real-world barriers end users encounter. The…

  web accessibility · accessibility metrics · accessibility evaluation · accessibility testing · conformance testing

• Proposing New Metrics to Evaluate Web Usability for the Blind

  Kentarou Fukuda, Shin Saito, Hironobu Takagi, Chieko Asakawa · 2005 · CHI '05 Extended Abstracts on Human Factors in Computing Systems

  This four-page CHI '05 extended abstract argues that existing automated accessibility checkers — in 2005 typified by Bobby — had plateaued: they verified the presence of ALT attributes, labels, and markup conformance, yet real blind users still found many 'compliant' web pages…

  web accessibility · accessibility evaluation · accessibility metrics · screen readers · voice browser

21 results.