Tangicraft: A Multimodal Interface for Minecraft
David Bar-El, Thomas Large, Lydia Davison, Marcelo Worsley · 2018 · Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18) · doi:10.1145/3234695.3241031
Summary
This demonstration paper presents Tangicraft, a work-in-progress multimodal interface designed to enable visually impaired children to play and collaborate in Minecraft, one of the world's most popular video games with over 121 million copies sold. Like most commercial games, Minecraft relies heavily on vision for navigation and participation, excluding children with visual impairments from a rich context for play, socialization, and learning. The design was informed by a survey of 13 parents of children with visual impairments, who reported that their children either needed to be very close to the screen to play independently or required someone to provide constant verbal descriptions of game events. Three design goals were derived: sensation (non-visual feedback about the game world), construction (building in Minecraft using tangible objects), and collaboration (supporting mixed-ability play). Two prototype strands were developed: a haptic wearable sleeve containing an Arduino Nano and a 3x3 grid of vibration motors that conveys the presence of blocks in front of the avatar's position, and a set of laser-cut wooden blocks with TopCodes (computer vision markers) that can be arranged physically in front of a webcam and placed into the Minecraft world via button press or speech command.
Key findings
Preliminary testing of Prototype 1 (haptic sleeve) with three blindfolded sighted college students revealed that users had difficulty distinguishing more than two vibration motors simultaneously, indicating a need for improved motor discernibility — possibly through force feedback or different motor configurations. Prototype 2 (tangible blocks) was tested with 14 sighted children (mean age 11.86) at a science and technology event, receiving a System Usability Scale (SUS) score of 72.32, which falls in the acceptable-to-good range. The tangible block interface bridges the physical and virtual worlds, allowing users to construct arrangements of real blocks that are then replicated in the Minecraft environment. The researchers acknowledge a key limitation: at the time of publication, user testing with visually impaired individuals had only just begun, so the effectiveness of the interface for the target population remained to be validated.
Relevance
This paper highlights an important but often overlooked aspect of accessibility: the right to play. Minecraft has become a significant social and educational platform for children, and exclusion from it means missing out on peer culture, collaborative learning opportunities, and creative expression — not just entertainment. The multimodal approach of combining haptic feedback for spatial awareness with tangible objects for construction represents a thoughtful translation of Minecraft's fundamentally visual and spatial gameplay into non-visual modalities. The emphasis on collaboration between sighted and visually impaired players reflects inclusive design principles where accessibility enables shared experience rather than creating separate, diminished versions. For practitioners, the work demonstrates that game accessibility often requires rethinking interaction paradigms rather than simply adding audio descriptions to visual content. The early-stage findings about haptic motor discernibility are practically useful for anyone designing wearable tactile displays for spatial information.
Tags: game accessibility · visual impairment · children · haptic feedback · tangible interface · multimodal interface · educational technology · inclusive design · Minecraft