Able to Read My Mail: An Accessible e-Mail Client with Assistive Technology
Horacio Saggion, Daniel Ferrés, Leen Sevens, Ineke Schuurman, Marta Ripollés, Olga Rodríguez · 2017 · Proceedings of the 14th International Web for All Conference (W4A) · doi:10.1145/3058555.3058567
Summary
This paper presents Kolumba, an accessible web-based email client developed as part of the EU-funded Able to Include project, specifically designed for people with intellectual or developmental disabilities (IDD). The tool addresses a critical gap in workplace digital inclusion: standard email programs are designed for a generic user, with complex menus, tabs, and functions that create barriers for people with IDD. Beyond interface complexity, the text content of emails itself poses a significant barrier — messages are typically written in language that may be too complex for people with IDD to understand. Kolumba tackles both problems through a simplified interface for basic email functions (send, receive, delete, manage contacts) and integration with an Accessibility Layer providing three NLP-powered assistive technologies: automatic text simplification (both lexical and syntactic), text-to-pictograph translation, and text-to-speech. The text simplification component performs two types of transformation: lexical simplification replaces complex words with simpler synonyms using word sense disambiguation, while syntactic simplification converts complex sentence structures (such as passive voice) into simpler forms using pattern-matching on dependency-parsed trees. The text-to-pictograph translation converts text into Sclera or Beta pictograph sequences using a pictographically annotated WordNet database. The tool was developed following a user-centred design process involving technologists, disability professionals, caregivers, and people with IDD from Fundación Prodis in Madrid.
Key findings
Validation with 62 IDD users using 30-item questionnaires (5-point Likert scale) produced encouraging results across ease of operation, text readability, pictograph comprehension, and understanding of spoken messages. The iterative testing process revealed specific areas for improvement: the text simplification system sometimes chose incorrect synonyms, which was addressed by excluding hypernyms from the dictionary and improving word-sense disambiguation by training on a larger corpus (Wikipedia). The pictograph translation was improved by updating the pictograph database and linking new pictographs to the dictionary. Users criticized the unnatural voice quality of the Spanish text-to-speech system, prompting a change in the synthesis engine. The paper demonstrates that automatic text simplification can be meaningfully applied to email communication — transforming passive voice to active, replacing formal vocabulary with common equivalents (e.g., "automobile" to "car", "repaired" to "fixed"). The tool was in its third cycle of testing at time of publication, with people with IDD and their carers reporting positive attitudes toward workplace integration of the tool.
Relevance
This research addresses a significantly underserved population in digital accessibility. While most accessibility work focuses on sensory or motor disabilities, people with intellectual and developmental disabilities face distinct barriers around language comprehension and interface complexity that require fundamentally different solutions. The application of NLP technologies — text simplification, pictograph translation, and text-to-speech — to everyday workplace tools like email represents a practical approach to reducing cognitive barriers at scale. The multilingual design (English, Spanish, Dutch) and the open-source codebase increase the potential for broader adoption. For accessibility practitioners, this work highlights that making digital tools accessible for people with IDD requires going beyond interface simplification to address content comprehension, and that NLP technologies can bridge this gap. The research also demonstrates the importance of iterative user-centred design with IDD populations, where each testing cycle revealed issues that automated evaluation could never detect.
Tags: intellectual disability · cognitive accessibility · text simplification · pictograph communication · workplace accessibility · natural language processing · assistive technology · user-centred design