Usability Issues with 3D User Interfaces for Adolescents with High Functioning Autism
Chao Mei, Lee Mason, John Quarles · 2014 · ASSETS '14: Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility · doi:10.1145/2661334.2661379
Summary
This paper investigates how adolescents with high-functioning autism spectrum disorder (ASD) perform basic 3D user interface tasks compared to typically developed (TD) peers. While VR and 3D interfaces are increasingly used in ASD therapy (e.g., driving simulation, social skills training), the usability of fundamental 3D interactions like rotation and translation has not been studied for the ASD population. Adolescents with ASD present a paradox: they often have enhanced spatial cognitive abilities but less efficient hand-eye coordination. The study used a matched-pair design with 20 male participants aged 9-18 (10 with ASD scoring above 71 on the GARS-3 severity scale, 10 TD controls matched by age). Participants used a Razer Hydra 6-degree-of-freedom controller to rotate and translate a 3D house model to match a target orientation/position, with spatial ability assessed through Embedded Figures and Mental Rotation tests.
Key findings
Participants with ASD performed 3DUI tasks less efficiently than TD participants on specific questions, spending significantly more time on certain rotation tasks (p<0.05) and translation tasks (p<0.05). The ASD group made significantly more operations (button presses) on some questions, indicating more adjustments and corrections. Critically, the most revealing finding was about the role of spatial ability versus hand-eye coordination: while both groups showed strong negative correlations between spatial ability scores and task errors, the TD group showed strong correlations between spatial ability and operation efficiency (speed, distance) that were absent in the ASD group. This suggests that the ASD group's spatial abilities did not translate into operational efficiency the way they did for TD participants—their hand-eye coordination deficits overrode their spatial advantages. Eight of ten ASD participants reported difficulties with the 3DUI interface. The ASD group also showed unnecessarily large rotation angles during translation tasks, further indicating hand-eye coordination challenges.
Relevance
As VR technology becomes more affordable and prevalent in therapeutic and educational applications for people with ASD, understanding the usability of basic 3D interactions is essential. This research provides the first generalizable evidence that hand-eye coordination deficits—not spatial cognition—are the primary barrier to 3DUI performance for adolescents with ASD. For designers of VR-based ASD interventions, this means: reduce the need for precise hand-eye coordination (e.g., larger tolerance zones, movement assistance, simplified controls), avoid assuming that enhanced spatial abilities will compensate for motor coordination challenges, and consider that certain orientations and positions may be systematically harder. The study also highlights that off-the-shelf consumer VR controllers can be used in research, making results more transferable to home therapeutic settings.
Tags: autism spectrum disorder · virtual reality · 3D user interfaces · spatial cognition · hand-eye coordination · usability · adolescents
Standards referenced: DSM-5