Vocational Rehabilitation of Individuals with Autism Spectrum Disorder with Virtual Reality
Lal Bozgeyikli, Evren Bozgeyikli, Andrew Raij, Redwan Alqasemi, Srinivas Katkoori, Rajiv Dubey · 2017 · ACM Transactions on Accessible Computing · doi:10.1145/3046786
Summary
This paper presents VR4VR, a comprehensive virtual reality system designed to train individuals with Autism Spectrum Disorder on transferable job skills. The system addresses a critical employment gap—while 66% of people with disabilities want employment, people with ASD have even lower employment rates than other disability groups. VR4VR trains six skills identified as transferable across many common jobs: cleaning (vacuuming, mopping, litter collection), shelving (warehouse organization), environmental awareness (navigating while avoiding obstacles and people), loading the back of a truck (spatial reasoning with boxes), money management (cash register operations), and social skills (responding to workplace conversations). The system uses a head-mounted display with optical motion tracking, tangible props (a real broomstick, physical boxes with markers, a pipe resembling a shopping cart handle), and a 180-degree curved screen for modules where body movements are not central. Five Florida state-certified vocational counselors with daily experience training people with autism were deeply involved in the iterative design process. Each skill module has three progressive levels: tutorial, practice without distractions, and practice with realistic workplace distractions (thunderstorms, chatting coworkers, fireworks, announcements). Job trainers control sessions via tablet, adjusting difficulty and triggering distractions in real time.
Key findings
A user study with 9 neurotypical controls and 9 high-functioning individuals with ASD found that follow-up surveys one month post-training showed improvement in all six skills for the ASD group. Money management showed the highest improvement rating (4.89/5), followed by social skills (4.67) and cleaning (4.71). Contrary to the hypothesis that workplace distractions would negatively affect ASD performance, no significant difference was found between scores with and without distracters. Post-interviews revealed why: participants with ASD were constantly aware that the distracters were virtual, not real, so they did not cause the same attention shifts that real-world distractions would. This finding relates to how individuals with ASD experience immersion differently—they reported high immersion scores but clarified they meant enjoying the VR experience rather than believing it was real. The loading-the-back-of-a-truck module scored lowest (3.29) because fitting boxes into a tight space required cognitive flexibility when rearrangement was needed, and instructions lacked sufficient step-by-step breakdown. Notably, six of nine ASD participants specifically mentioned learning cash register skills as valuable—employers often hesitate to train people with ASD on real money handling, making VR training particularly useful for this skill.
Relevance
This research offers practical design guidelines for VR applications targeting users with ASD. Key recommendations include: use positive reinforcement exclusively (avoid words like "failed" which caused visible distress); break complex tasks into small explicit steps rather than demonstrating whole workflows; keep instructions extremely brief and literal since ambiguous instructions caused confusion; provide narrow structured frameworks with gradual expansion rather than open exploration spaces; embrace repetition since ASD users do not show the boredom neurotypical users do; use soft stable wearables to minimize sensory irritation; implement mandatory breaks since ASD users may push through exhaustion to maintain routine; maintain strict visual consistency across difficulty levels; and include extreme social scenarios to prepare for real workplace situations. For organizations, VR offers a safe space for job skill assessment and training where errors have no real consequences, potentially expanding employment opportunities by demonstrating capabilities to hesitant employers.
Tags: virtual reality · autism spectrum disorder · vocational rehabilitation · job training · immersive technology · user-centered design