Screenless Interaction

Interaction with digital systems that does not require a visual display, enabling users to operate devices while untethered from screens. For people who are blind, screenless interaction eliminates the need to hold and touch a phone screen to find visual affordances they cannot see — a process that is particularly impractical while walking with a cane or guide dog. Screenless interaction relies on alternative modalities such as audio feedback, haptic feedback, gesture input via wearables, and voice commands. Research in this area explores how to redesign traditionally visual interactions (like text entry, navigation, and information browsing) for entirely non-visual operation, often trading speed for the practical benefits of being untethered from a device.