Interactive Virtual Client for Teaching Occupational Therapy Evaluative Processes
Sharon Stansfield, Tom Butkiewicz, Evan Suma, Marilyn Kane · 2005 · Proceedings of the 7th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '05) · doi:10.1145/1090785.1090822
Summary
This paper from Ithaca College describes a computer-based educational tool for occupational therapy (OT) students learning client evaluation techniques. The system uses a dialogue-based interface where students interact with a virtual client — a 3D character built using Valve's Source game engine SDK (the engine behind Half-Life 2). The virtual client is modelled as an OT patient who has suffered a left cerebrovascular accident (L-CVA, a stroke) resulting in impaired movement on his right side and partial facial paralysis. The facial paralysis is specifically included as a training challenge because it makes reading the client's emotional state more difficult — for example, a smile may appear as a grimace when part of the face does not move. The student conducts an evaluation by selecting from menus of choices for interacting with the virtual client, such as different greeting styles that vary in formality and appropriateness. The virtual client's responses are animated and vocal, with lip synchronisation and dynamically selected behaviours based on the student's choices. All student actions are logged to a file for instructor review and self-evaluation. The motivation for the tool is that OT students typically practise evaluation procedures with each other or with their instructor, but never with actual clients who have disabilities, making the process lack realism.
Key findings
At the time of publication, the team had implemented the initial client interview portion of the evaluation, demonstrating that the Source game engine could be effectively repurposed for clinical education. The system successfully renders a virtual OT clinic environment with an animated client whose behaviours — both body and facial movements — are programmatically controlled through extended Source engine code that reads behaviour specifications from files at initialisation. Client responses are dynamically chosen and played based on student selections, allowing the virtual patient to respond differently depending on the student's approach. The authors outline planned future work including implementing the remaining COPM assessment tasks (having the virtual client perform requested physical tasks), creating appropriate dialogue-based interactions for the full evaluation, fielding the tool in the OT Department at Ithaca College, and expanding to virtual clients with other impairments. They also note plans to move toward more natural interaction forms, such as speech recognition, to replace menu-based input.
Relevance
This paper demonstrates an innovative application of commercial game engine technology for healthcare education related to disability. The approach of using a virtual client with specific impairments — stroke-related movement limitations and facial paralysis — gives OT students exposure to realistic disability presentations before they encounter real clients. This is particularly valuable because the emotional and physical complexity of disability cannot be easily simulated by able-bodied classmates role-playing as patients. For accessibility practitioners, the work highlights how virtual simulation can be used to build empathy and clinical competence in professionals who will work with disabled individuals. The use of an inexpensive, well-documented game engine rather than custom simulation software is a pragmatic design choice that made the project feasible within an academic setting. While the system was still a prototype, the concept of using interactive virtual characters to teach disability-related professional skills has since expanded considerably with advances in VR and AI-driven conversational agents.
Tags: occupational therapy · virtual patient · educational technology · simulation · serious games · stroke recovery · clinical tools · rehabilitation
Standards referenced: Canadian Occupational Performance Measure