Forcing Standardization or Accommodating Diversity? A Framework for Applying the WCAG in the Real World
Brian Kelly, David Sloan, Lawrie Phipps, Helen Petrie, Fraser Hamilton · 2005 · Proceedings of the 2005 International Cross-Disciplinary Workshop on Web Accessibility (W4A) · doi:10.1145/1061811.1061820
Summary
This paper critically examines how the W3C Web Content Accessibility Guidelines (WCAG 1.0) were being applied in practice six years after their publication, arguing that rigid, context-free application of WCAG was creating serious problems for web developers and policymakers alike. The authors — drawing on extensive experience promoting accessibility across UK education, cultural heritage, business, and public sectors — identify several practical difficulties with WCAG 1.0: its theoretical nature favoring W3C technologies over widely-used proprietary formats like PDF and Flash; its dependency on a tripartite model (WCAG, UAAG, ATAG) that assumed compliant browsers and authoring tools web authors had no control over; ambiguous language such as "until user agents" that led to divergent interpretations; logical inconsistencies in versioning requirements; and a complexity level that overwhelmed non-specialist developers. The paper surveys accessibility legislation across multiple jurisdictions — Australia's DDA (citing the landmark SOCOG Olympic Games case), US Section 508 and ADA, Italy's 2004 accessibility law, and the UK's DDA — showing how each took different approaches to referencing WCAG, creating an uneven and sometimes contradictory legal landscape. Rather than abandoning guidelines, the authors propose a holistic framework originally developed for e-learning accessibility that considers context of use, intended audience, usage environment, service delivery role, and resource lifecycle before determining how to apply WCAG checkpoints. This framework shifts focus from checkbox compliance toward ensuring disabled people can actually use the resource for its intended purpose.
Key findings
Surveys cited in the paper found disturbingly low WCAG conformance rates: only 43% of UK university entry points met WCAG Level A in 2002, rising to just 58% by 2004, while a Disability Rights Commission audit of 1,000 UK websites found only 19% appeared Level A conformant. Critically, the paper presents evidence that WCAG conformance and actual usability by disabled people were poorly correlated — the DRC investigation found websites that performed well with disabled users yet failed WCAG conformance checks, while museum website audits revealed sites with high WCAG conformance that were "accessibility catastrophes" when tested with disabled users. The authors identify a destructive tension between automated guideline evaluation and human-based evaluation, exemplified by a public dispute between testing company Sitemorse and the DRC. They argue that WCAG priority levels do not reliably indicate real-world impact — a frequent Priority 3 failure like missing skip navigation links could be more harmful than a Priority 1 failure involving alt text on a rarely-seen spacer image. The proposed holistic framework requires documenting context-specific decisions about proprietary technology use, HTML validation targets, user involvement strategies, and justified departures from specific WCAG checkpoints.
Relevance
This paper was prescient in identifying tensions that persist in accessibility practice today: the gap between technical conformance and actual user experience, the limitations of automated testing, and the need for context-sensitive application of guidelines. Many of its critiques directly influenced the development of WCAG 2.0, which adopted technology-neutral success criteria and testable conformance requirements. The holistic framework anticipates modern approaches that combine standards compliance with usability testing involving disabled people. For practitioners, the paper remains a valuable reminder that accessibility is experiential, not merely technical — passing an automated audit does not guarantee a usable experience for disabled people. The argument for documented, justified departures from specific guidelines when context demands it foreshadows contemporary discussions about conformance versus real-world accessibility outcomes.
Tags: web accessibility · WCAG · accessibility policy · accessibility guidelines · holistic accessibility · user evaluation · automated testing · accessibility legislation
Standards referenced: WCAG 1.0 · WCAG 2.0 · Section 508 · UAAG · ATAG