Refreshable Braille Oral Appliance
M. A. Naomi Jobrack · 2015 · Proceedings of the 12th International Web for All Conference (W4A) · doi:10.1145/2745555.2746675
Summary
This paper presents preliminary research toward developing a Refreshable Braille Oral Appliance (RBOA) — a refreshable Braille display embedded in an oral retainer that would allow users to read Braille with their tongue. The envisioned device connects to a wireless lapel microphone and smartphone application to provide real-time speech-to-Braille conversion, primarily aimed at helping deaf individuals understand spoken language by receiving a tactile text stream in their mouth while lip-reading. The concept draws on three lines of prior research: the MIT Palatograph (1992), an artificial palate with 63 cone detectors that helped hearing-impaired participants improve speech through tongue placement feedback; Weisenberger and Hasser's (1994) work comparing static, passive, and haptic scanning modes for tactile pattern identification; and the Opticon (1960s), an early refreshable vibratory array that enabled blind users to read at up to 60 words per minute. The fundamental research question was whether the human tongue has sufficient tactile sensitivity to discriminate Braille characters, given that the touch homunculus (mapped by Clinton Woolsey in the 1940s) represents the tongue as larger and more sensitive than the fingertip.
Key findings
The study used a 2x2 mixed design with 10 participants (5 blind Braille-experienced adults recruited through the Doran Center for the Blind in Santa Cruz, and 5 sighted adults with no Braille familiarity from San Jose State University). Participants performed same/different discrimination tasks on Braille letters (A through T) in two conditions: comparing letters between the index fingers of both hands, and comparing between the dominant index finger and the tongue. Stimuli were Braille letters punched into embossing tape attached to popsicle sticks (for tongue) and index cards (for fingers). Results showed that sighted participants averaged 4.6 errors (finger-to-finger) and 7.2 errors (finger-to-tongue), while blind participants averaged 2.4 errors (finger-to-finger) and 5.8 errors (finger-to-tongue). A 2x2 mixed ANOVA revealed that participants could read Braille with their tongues as easily as with their non-dominant index finger. Blind participants performed better in both conditions but the difference was not statistically significant. Blind participants reported that Braille patterns felt closer together on their tongues than on their fingertips, suggesting that dot spacing calibration (potentially using jumbo Braille) would be important for an oral device. The author also notes potential for the oral appliance as a control interface for remote-controllable technology (lights, wheelchairs, door locks).
Relevance
This is an inventive exploration of sensory substitution — using the tongue's high tactile sensitivity to create a discreet, hands-free communication channel. The primary application for deaf users is compelling: an invisible oral device providing real-time text of spoken language could supplement lip-reading without the social visibility of other assistive devices. The secondary applications (tongue-based control of wheelchairs, smart home devices) could benefit people with severe physical disabilities who cannot use their hands. However, this is a very preliminary feasibility study with significant limitations: only 10 participants, no actual prototype device, crude stimuli (embossing tape on popsicle sticks rather than electronic actuators), and no measurement of reading speed or continuous text comprehension. The jump from demonstrating basic letter discrimination to a functional real-time speech-to-Braille oral device involves enormous engineering challenges not addressed here. The concept remains intriguing as an example of creative thinking about alternative sensory channels for assistive technology.
Tags: braille · haptics · refreshable display · deaf accessibility · assistive technology · tactile perception · sensory substitution · oral appliance