Understanding Accessibility as a Process through the Analysis of Feedback from Disabled Students
Tim Coughlan, Thomas Daniel Ullmann, Kate Lister · 2017 · Proceedings of the 14th International Web for All Conference (W4A) · doi:10.1145/3058555.3058561
Summary
This paper from The Open University UK analyzes over 6,000 open comment feedback responses from disabled students (out of 93,148 total responses) to argue that accessibility must be understood as an ongoing process rather than a state achieved through technical guideline compliance. The OU is a distance learning institution that has supported thousands of disabled students over decades, making it a uniquely rich context for studying accessibility at scale. The researchers applied both automated keyword analysis (using log-likelihood ratios to identify terms unusually frequent or infrequent in disabled students' comments compared to the general population) and manual thematic analysis using NVivo. Student comments were linked to declared disability categories including Autistic Spectrum, Fatigue/Pain, Hearing, Manual Skills, Mental Health, Mobility, Sight, SpLD (e.g., Dyslexia), and Speech, among others. The paper frames accessibility as contextual and relational — citing Cooper et al.'s assertion that "accessibility is not an intrinsic quality of a resource" but only truly achieved with consideration of user and contextual factors — and argues that WCAG 2.0 covered only 50.4% of problems encountered by blind users in one study.
Key findings
Keyword analysis revealed distinct vocabulary patterns across disability categories: students with sight disabilities disproportionately mentioned "screen reader" and "difficulties"; those with SpLD/dyslexia mentioned "dyslexic," "mini lectures," and "voice"; autistic spectrum students mentioned "bus," "textbooks," and "miles"; mental health students mentioned "confidence," "health issues," and "internet explorer." Thematic analysis identified two particularly important procedural dimensions: (1) Changes to the individual over time — students develop skills, strategies, and confidence levels that shift throughout their studies, meaning a timely piece of information or support can have enormous long-term impact, while an unexpected change in course resources or a temporary change in abilities can have lasting ramifications. A student newly diagnosed with dyslexia described losing "all my faith and confidence" before support helped them resume studying. (2) Interpersonal interactions — experiences with tutors, staff, and other students are central to accessibility. Students valued staff who showed consideration of their needs, but were disrupted when moving between tutors caused inconsistency. Collaborative activities posed particular challenges: a student "new to being blind" found the pace of forum discussions overwhelming with a screen reader. The research also found that students with multiple disabilities face emergent challenges not predictable from individual conditions.
Relevance
This paper makes a fundamental conceptual contribution to accessibility practice: accessibility is not a checkbox to be ticked during development but a continuous process of understanding and responding to individual users' evolving needs and contexts. For accessibility practitioners, this reframes the role of user feedback from quality assurance to ongoing organizational learning. The finding that different disability categories use distinctly different language when describing their experiences has practical implications for automated feedback triage — keyword dictionaries could route accessibility-related comments to appropriate specialists. The developmental perspective — that students' accessibility needs change as their skills, confidence, and circumstances evolve — challenges static accommodation models and suggests that accessibility support must be adaptive over time. The paper's recommendations for embedding feedback into organizational processes (getting relevant feedback to the right staff, using automated classification, designing socially-accessible interactions) are applicable to any web service or platform with a sustained user relationship, not just educational institutions.
Tags: education accessibility · disability · organizational accessibility · distance learning · accessibility theory · user research · qualitative research
Standards referenced: WCAG 2.0