Evaluation of Scanning User Interfaces Using Real-Time-Data Usage Logs
Peter O'Neill, Chris Roast, Mark Hawley · 2000 · Proceedings of the Fourth International ACM Conference on Assistive Technologies (Assets '00) · doi:10.1145/354324.354355
Summary
This paper from Sheffield Hallam University and Barnsley District General Hospital presents a novel approach to evaluating electronic assistive technology (EAT) for people with severe disabilities through automated analysis of real-time usage logs. The research focuses on the Barnsley Wheelchair Interface (BWI), a scanning-based mobility interface that allows individuals who can only operate a single switch to control an electric wheelchair. The BWI operates within BASE (Barnsley Active Switch Environment), an integrated system that provides access to multiple applications — voice output, environmental control, and wheelchair driving — through a single switch input using a pictorial sequential highlighting menu. The wheelchair interface displays directional options that are highlighted sequentially at a clinician-configured scan rate (one second in this case); when the desired direction is highlighted, the user presses and holds the switch to move in that direction. The researchers developed three analysis techniques for the usage logs: sequence profiling (characterizing pairs of consecutive directional selections), direction profiling (frequency and duration of movements in each direction), and human performance modelling using the Horstmann and Levine model that accounts for perception, motor, and cognitive cycles. These techniques allow comparison of different BWI configurations — specifically three highlighting methods (clockwise, anti-clockwise, and step patterns) combined with forward-first and forward-bias options.
Key findings
Analysis of approximately 1800 log records from a twelve-year-old boy with athetoid cerebral palsy over one week revealed several significant insights. Forward movement dominated both in frequency and duration, with forward-left and forward-right as the next most common directions — consistent with the navigational demands of corridors and doorways. The short average duration of movements (0.59 to 2.78 seconds depending on direction) suggested either environmental constraints limiting movement distance or the user's difficulty maintaining continuous switch closure. The sequence profile showed strong directional bias, with many movements followed by re-selection of the same direction, indicating the user may have been unable to hold the switch long enough. A particularly notable observation was the user actively manipulating the highlighting order by intentionally selecting an unwanted direction briefly to reset the scan sequence back to forward, effectively reducing scanning time — a sophisticated strategy the researchers noted would need formal validation. The performance modelling showed that the "Forward Bias, Forward First, Anti-clockwise" scanning method was most efficient for this individual, requiring approximately 400 fewer seconds of scanning time per week than the other methods tested.
Relevance
This research addresses a critical gap in assistive technology practice: the lack of objective, quantifiable feedback about how users actually interact with their prescribed devices. Traditional AT assessment relies heavily on clinical observation and subjective judgment, which is particularly challenging with severely disabled users who may have limited ability to communicate their experience. The automated usage logging approach provides clinicians with data-driven evidence to optimize device configuration — a principle now embedded in modern AT practice through analytics in communication aids and other assistive devices. For practitioners, the key takeaway is that AT configuration should be treated as an iterative, data-informed process rather than a one-time clinical decision. The finding that the user developed his own strategy to manipulate the scanning system highlights that users with severe physical disabilities can be cognitively sophisticated in their AT use, and that usage analysis can reveal adaptive behaviors that clinical observation might miss.
Tags: switch access · scanning interface · assistive technology · cerebral palsy · usage analytics · wheelchair accessibility · motor disability · evaluation methods · clinical tools · personalization