The PhonicStick: A Joystick to Generate Novel Words Using Phonics
Rolf Black · 2011 · The Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2011) · doi:10.1145/2049536.2049630
Summary
This short paper introduces the PhonicStick, a novel joystick-based device that enables non-speaking children to explore letter sounds (phonics) and blend them into words. The motivation stems from a key limitation of existing Voice Output Communication Aids (VOCAs): while VOCAs allow users to select pre-stored words or phrases via letter input, they provide no support for playing with sounds or blending phonemes into novel words — a foundational activity in literacy development. The PhonicStick maps six phonemes (/s/, /a/, /i/, /p/, /n/, and a vowel) from the first stage of the Jolly Phonics programme onto joystick movements in six directions (forward, backward, left, right, diagonal, and circumference). To select a phoneme, the user moves the joystick along a specific path and back to centre. Selected phonemes are played back as high-quality recorded speech from a native English speaker via a connected laptop. Users can then hear the blended version of their collected phonemes by pressing a playback button. The prototype uses switched joysticks connected via serial port, with two non-latching switches for playback and clearing. The author conceived the device from observations of children with severe physical impairments who could successfully control electric wheelchairs with joysticks but struggled with touch-screen or switch-based communication devices.
Key findings
An evaluation with seven children — five with physical and/or learning disabilities (three with cerebral palsy using joystick-controlled wheelchairs, one with Down's syndrome, one with dancing eye syndrome) and two typically developing children — showed promising results after just one 20-minute training session. All seven children were able to retrieve all six phonics and sound out words within a game scenario. Two children with physical disabilities had difficulty accessing some phoneme positions but demonstrated they knew all six positions. One child with cerebral palsy spontaneously used the device as an augmentative communication aid, intuitively using it to clarify his dysarthric speech. The typically developing children went beyond the structured tasks, initiating the generation of novel words including their own names. One initially disengaged child with cerebral palsy became enthusiastic when invited to "play" rather than learn, generating a taboo word during an official event — demonstrating genuine creative engagement with sound. The inclusion of "non-desirable" words, usually omitted from standard VOCAs, was noted as having potential to greatly increase motivation for device use.
Relevance
The PhonicStick addresses a significant gap in AAC technology: the absence of tools that support sound exploration and phonological play for non-speaking children. Current VOCAs focus on functional communication rather than literacy development, meaning non-speaking children miss out on the sound-blending activities that are central to how speaking children learn to read. The joystick-based interface is a clever design choice, leveraging motor skills that children with cerebral palsy may already have from wheelchair use. For accessibility practitioners and AAC developers, this work highlights the importance of designing tools that go beyond functional communication to support the broader developmental activities — including creative play — that contribute to literacy. The small sample and single-session evaluation limit conclusions, but the spontaneous, creative uses children found for the device suggest strong engagement potential. Future work planned includes haptic feedback, eye gaze access methods, and investigating different phonic layouts for different disability groups.
Tags: AAC · phonological awareness · literacy · joystick · cerebral palsy · phonics · assistive technology · children · voice output · alternative input