A Pool of Representative Users for Accessibility Research: Seeing through the Eyes of the Users
Marianne Dee, Vicki L. Hanson · 2016 · ACM Transactions on Accessible Computing (TACCESS) · doi:10.1145/2845088
Summary
This paper documents the establishment, management, and lessons learned from the SiDE (Social Inclusion through the Digital Economy) User Pool, a large participant pool of over 800 older adults created at the University of Dundee to support accessibility and digital inclusion research over five years. The paper addresses a fundamental challenge in accessibility research: recruiting sufficient numbers of representative users — particularly older adults with varying abilities, technology experience, and cognitive profiles — in a timely manner. The SiDE User Pool was managed by a dedicated pool manager who recruited participants through face-to-face community engagement, maintained a database of demographics, cognitive test scores (using the CREATE battery measuring perceptual speed, working memory, reasoning, and vocabulary), and personal notes about each participant. The pool supported 42 studies involving 51 researchers across multiple universities. The paper provides detailed practical guidance on recruitment strategies, data gathering protocols, relationship building, ethical considerations for working with vulnerable populations, and operational lessons. A key philosophical principle throughout is "seeing through the eyes of the users" — treating participants as equal partners rather than objects of study. The authors found that face-to-face recruitment through community groups was far more effective than newspaper advertisements or posters, that relationship building was essential for retention, and that a dedicated pool manager with strong interpersonal skills was the critical success factor.
Key findings
The paper identifies several key lessons for establishing accessibility research participant pools. First, reciprocity is the primary motivation for participation — participants wanted to contribute and give back, not earn money. Gift vouchers were provided for ethical reasons but participants emphasized the value of feeling useful and contributing to knowledge. Second, the pool manager role was irreplaceable: this person built trust relationships over years, maintained informal notes about participants (health changes, preferences, social contexts), and could sensitively identify people matching specific research criteria through conversation rather than database queries. Third, researchers overwhelmingly used the pool for evaluation studies rather than early-stage co-design or formative research, representing a missed opportunity for true user-centered design. Fourth, working with vulnerable populations (including people with dementia) required adapted methodologies: conventional interviews and Likert scales may be too complex, reading-dependent materials exclude those with literacy difficulties, and focus groups are inaccessible for people with hearing problems. The authors propose guidelines including personalizing each research consultation, communicating with clarity and patience, providing meaningful context, building relationships before requesting participation, and allocating time for unpredictable events. Standardized cognitive testing (CREATE battery) enabled researchers to pre-screen participants by ability rather than age alone.
Relevance
This paper is essential reading for any accessibility research group seeking to conduct studies with older adults or people with disabilities. The practical guidance — from recruitment marketing language (avoiding jargon, not being patronizing or ageist) to study-day logistics (offering refreshments, showing toilets, providing route maps) — reflects hard-won experience that most methodology textbooks omit. The emphasis on relationship-based recruitment over transactional approaches has profound implications: accessibility research that treats participants as data sources rather than partners will struggle with recruitment, retention, and ecological validity. The finding that researchers defaulted to evaluation studies rather than involving users in problem definition and design stages mirrors a broader pattern in accessibility research. For institutions, the case for dedicated pool manager funding is compelling — the SiDE pool enabled rapid researcher access to testing within days of ethical approval, a dramatic improvement over typical recruitment timelines. The guidelines for working with vulnerable populations, particularly those with dementia, fill an important gap in accessibility research methodology.
Tags: research methods · participant recruitment · older adults · user pool · accessibility research · digital inclusion · vulnerable populations · ethics