← Writing · Glossary →

Reviews

The literature-review database. Every paper Bob has reviewed (he has read many more), with a short summary, key findings, and tags. Browse, filter, search.

Search results

  • Reliability Aware Web Accessibility Experience Metric

    Shuyi Song, Jiajun Bu, Chengchao Shen, Andreas Artmeier, Zhi Yu, Qin Zhou · 2018 · Proceedings of the 15th International Web for All Conference (W4A)

    This paper introduces RA-WAEM (Reliability Aware Web Accessibility Experience Metric), a novel approach to measuring website accessibility that incorporates actual user experience from people with disabilities while accounting for the varying reliability of different evaluators.…

    accessibility metrics · user experience · accessibility evaluation · machine learning · web accessibility

  • "I knew that, I was just testing you": Understanding Older Adults' Impression Management Tactics During Usability Studies

    Rachel L. Franz, Ron Baecker, Khai N. Truong · 2018 · ACM Transactions on Accessible Computing

    This paper investigates how older adults (65+) engage in impression management (IM) during usability studies—conscious or unconscious behaviors to present themselves favorably to researchers. While IM is known to affect research validity, its specific manifestations in…

    older adults · aging · usability testing · research methodology · user research

  • Active Learning for Web Accessibility Evaluation

    Mengni Zhang, Can Wang, Zhi Yu, Chao Shen, Jiajun Bu · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

    This paper introduces "active-prediction," a semi-supervised machine learning method that addresses a fundamental bottleneck in web accessibility evaluation: the prohibitive cost of evaluating all pages in a large website. Current practice relies on sampling methods (ad hoc,…

    accessibility evaluation · machine learning · active learning · web accessibility · automated testing

  • WAEM: A Web Accessibility Evaluation Metric Based on Partial User Experience Order

    Shuyi Song, Can Wang, Liangcheng Li, Zhi Yu, Xiao Lin, Jiajun Bu · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

    This paper introduces WAEM (Web Accessibility Experience Metric), a novel accessibility metric that derives checkpoint weights from actual user experience data rather than from WCAG priority levels. The authors demonstrate that existing metrics like WAB and WAQM, which weight…

    accessibility metrics · user experience · accessibility evaluation · machine learning · SVM

  • Subjective Evaluation of Website Accessibility and Usability: A Survey for People with Sensory Disabilities

    Tahani Alahmadi, Steve Drew · 2017 · Proceedings of the 14th International Web for All Conference (W4A)

    This paper presents a novel subjective evaluation model for assessing web accessibility and usability from the perspective of students with sensory disabilities, applied to Australian university websites. The model integrates accessibility criteria from WCAG 2.0 and Section 508…

    accessibility evaluation · usability · university websites · education accessibility · sensory disabilities

  • Development technologies impact in web accessibility

    Carlos Duarte, Inês Matos, João Vicente, Ana Salvado, Carlos M. Duarte, Luís Carriço · 2016 · Proceedings of the 13th International Web for All Conference (W4A)

    This study investigates whether the choice of web development technologies—programming languages, web frameworks, JavaScript frameworks, and content management systems—has a measurable impact on the accessibility of resulting web pages. The researchers crawled 1,669 pages from…

    web accessibility · automated testing · web development · content management systems · JavaScript frameworks

  • DOM block clustering for enhanced sampling and evaluation

    Simon Harper, Anwar Ahmad Moon, Markel Vigo, Giorgio Brajnik, Yeliz Yesilada · 2015 · Proceedings of the 12th International Web for All Conference (W4A)

    This paper addresses a fundamental challenge in web accessibility evaluation: large websites with thousands or tens of thousands of pages are practically impossible to fully evaluate, yet current sampling methods (random, best-guess, or convenience samples) cannot be trusted…

    accessibility evaluation · automated testing · web crawling · sampling methodology · DOM analysis

  • Acrolinx: A Controlled-Language Checker Turned into an Accessibility Evaluation Tool for Image Text Alternatives

    Silvia Rodríguez Vázquez, Sabine Lehmann · 2015 · Proceedings of the 12th International Web for All Conference (W4A)

    This paper presents a novel application of controlled-language checking technology to a persistent accessibility problem: evaluating the quality of image text alternatives, not just their presence. The authors observe that while most web accessibility evaluation tools can detect…

    alt text · image accessibility · automated testing · controlled language · natural language processing

  • A4TV: Assessing and Ameliorating the Accessibility of the Ascending Connected TV Platforms

    Daniel Costa · 2015 · Proceedings of the 12th International Web for All Conference (W4A)

    This doctoral consortium paper proposes a two-stage research programme to study and improve the accessibility of connected TV platforms for visually impaired users. Connected TVs — smart TVs and set-top boxes with internet connectivity — use web technologies (HTML5, JavaScript)…

    connected TV · blindness · visual impairment · accessibility evaluation · multimodal interaction

  • An Optimal Sampling Method for Web Accessibility Quantitative Metric

    Mengni Zhang, Can Wang, Jiajun Bu, Zhi Yu, Yi Lu, Ruijie Zhang, Chun Chen · 2015 · Proceedings of the 12th International Web for All Conference (W4A 2015)

    This short paper proposes OPS-WAQM, an optimal page sampling method specifically designed for use with the Web Accessibility Quantitative Metric (WAQM) when evaluating large websites. The core problem is that evaluating every page of a large website for accessibility is…

    accessibility evaluation · sampling methods · accessibility metrics · WAQM · large-scale evaluation

  • Are Users the Gold Standard for Accessibility Evaluation?

    Amaia Aizpurua, Myriam Arrue, Simon Harper, Markel Vigo · 2014 · Proceedings of the 11th Web for All Conference (W4A)

    This paper critically examines whether user testing with blind users is a reliable "gold standard" for web accessibility evaluation. Drawing on an exploratory study with 11 legally blind participants (10 JAWS users, 1 VoiceOver user, ages 21-64) who navigated four restaurant…

    user testing · accessibility evaluation · blind users · screen readers · research methodology

  • Buildings and Users with Visual Impairment: Uncovering Factors for Accessibility Using BIT-Kit

    Lesley J. McIntyre, Vicki L. Hanson · 2014 · ASSETS '14: Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility

    This paper introduces BIT-Kit (Building Interactions Tool-kit), a mixed-method framework for gathering evidence about how buildings impact the accessibility of users with visual impairments. The framework combines three methods: semi-structured interviews about past building…

    visual impairment · wayfinding · built environment · architecture · accessibility evaluation

  • Evaluating the Accessibility of Crowdsourcing Tasks on Amazon's Mechanical Turk

    Rocío Calvo, Shaun K. Kane, Amy Hurst · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS)

    This paper presents a heuristic accessibility evaluation of Amazon Mechanical Turk (MTurk), a crowdsourcing platform where workers complete short tasks (Human Intelligence Tasks, or HITs) for small payments. The authors argue that crowd work platforms offer a potentially…

    crowdsourcing · web accessibility · accessibility evaluation · employment · WCAG

  • Web Accessibility Evaluation with the Crowd: Using Glance to Rapidly Code User Testing Video

    Mitchell Gordon · 2014 · Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS)

    This paper proposes using Glance, a crowd-powered video coding tool, to accelerate the analysis of user accessibility testing videos. User testing with people with disabilities is a recommended component of web accessibility evaluation (as outlined in the W3C Website…

    crowdsourcing · accessibility evaluation · usability testing · video coding · web accessibility

  • Towards Web Accessibility Repair

    Nádia Fernandes · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This doctoral consortium paper presents early-stage research on automatically evaluating and repairing accessibility problems in Rich Internet Applications (RIAs). The author identifies a critical gap: as the web evolves from static pages to complex, dynamic applications,…

    automated testing · accessibility evaluation · accessibility repair · rich internet applications · ARIA

  • Evaluating Accessibility-in-Use

    Markel Vigo, Simon Harper · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This paper introduces a novel method for evaluating web accessibility that goes beyond traditional guideline conformance testing. The authors argue that standards like WCAG 2.0 capture only about 53% of accessibility problems experienced by users, missing issues such as broken…

    accessibility evaluation · user interaction · behavioural analysis · screen readers · blind and low vision

  • Benchmarking Web Accessibility Evaluation Tools: Measuring the Harm of Sole Reliance on Automated Tests

    Markel Vigo, Justin Brown, Vivienne Conway · 2013 · Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This paper provides rigorous empirical evidence on the limitations of automated web accessibility evaluation tools by benchmarking six state-of-the-art tools — AChecker, SortSite, Total Validator, TAW, Deque, and AMP — against expert manual evaluations of three Australian…

    automated testing · accessibility evaluation · WCAG compliance · evaluation tools · benchmarking

  • Certification or Conformance: Making a Successful Commitment to WCAG 2.0

    Suzette Keith, Nikolaos Floratos, Gill Whitney · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

    Commissioned by ANEC (the European consumer voice in standardisation), this study examined whether voluntary self-declaration or third-party certification of web accessibility conformance translates into actual compliance with WCAG 2.0. The researchers selected 100 websites from…

    WCAG compliance · accessibility evaluation · certification · conformance testing · e-government

  • Guidelines, Icons and Marketable Skills: An Accessibility Evaluation of 100 Web Development Company Homepages

    Teresa D. Gilbertson, Colin H. C. Machin · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This study examined whether web development companies that market accessibility as a skill actually practice what they preach, by evaluating the homepages of 100 UK web development companies selected from Google searches across four geographic regions. Each homepage was tested…

    web accessibility · WCAG compliance · developer awareness · conformance testing · accessibility evaluation

  • Evaluation of the Effectiveness of a Tool to Support Novice Auditors

    Christopher Bailey, Elaine Pearson · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This paper evaluates the Accessibility Evaluation Assistant (AEA), a web-based knowledge management tool designed to help novice auditors conduct accessibility evaluations, by comparing it against standard WCAG 2.0 conformance review. The AEA was developed at Teesside University…

    accessibility evaluation · accessibility education · WCAG compliance · evaluation tools · accessibility training

  • Getting One Voice: Tuning Up Experts' Assessment in Measuring Accessibility

    Silvia Mirri, Paola Salomoni, Ludovico A. Muratori, Matteo Battistelli · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This paper addresses a fundamental challenge in web accessibility evaluation: how to reconcile the subjective assessments of multiple human experts into a single, reliable accessibility measurement. While automated testing tools produce binary pass/fail results for detectable…

    accessibility metrics · accessibility evaluation · manual evaluation · automated testing · expert assessment

  • MIPAW: Modele of a Progressive Implementation of Web Accessibility

    Jean-Pierre Villain, Olivier Nourry · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This paper presents MIPAW (Modele of a Progressive Implementation of Web Accessibility), a framework for reorganizing WCAG criteria into a user-centric, phased implementation model. The authors, who lead the AccessiWeb reference list — the most widely implemented WCAG-based…

    WCAG implementation · progressive enhancement · accessibility strategy · quality assurance · accessibility evaluation

  • AMAri: A Reporting Interface for Accessibility Evaluations

    Silvia Mirri, Matteo Casadei, Ludovico A. Muratori, Matteo Battistelli, Paola Salomoni · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This short paper presents AMAri (Accessibility Monitoring Application Reporting Interface), an open-source web-based tool designed to make large-scale accessibility evaluation data understandable and actionable for distributed web authoring and editorial teams. AMAri sits on top…

    accessibility monitoring · accessibility evaluation · data visualization · accessibility tools · reporting

  • Evaluating the Accessibility of Rich Internet Applications

    Nádia Fernandes, Daniel Costa, Sergio Neves, Carlos Duarte, Luís Carriço · 2012 · Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

    This paper addresses a critical gap in automated accessibility evaluation: most tools only assess the initial HTML served to the browser, missing the dynamically generated content that defines modern Rich Internet Applications (RIAs). Web applications using JavaScript and AJAX…

    automated testing · web accessibility · rich internet applications · AJAX · dynamic content

  • Is Accessibility Conformance an Elusive Property? A Study of Validity and Reliability of WCAG 2.0

    Giorgio Brajnik, Yeliz Yesilada, Simon Harper · 2012 · ACM Transactions on Accessible Computing

    This landmark study investigates whether WCAG 2.0's definition of "Reliably Human Testable"—that at least 80% of knowledgeable evaluators would agree on an audit conclusion—is actually achievable in practice. The researchers recruited 25 experienced accessibility evaluators…

    WCAG · conformance testing · accessibility evaluation · evaluator effect · reliability