Gesture-based interaction
Also known as: Gestural interface, Touchless interaction
An interaction modality where users control technology through body movements, hand gestures, or postures detected by sensors such as depth cameras, rather than through traditional input devices like keyboards, mice, or touchscreens. Gesture-based interaction can benefit people with motor disabilities who cannot use conventional input devices, individuals with developmental disabilities who benefit from embodied and natural interaction paradigms, and contexts where touchless operation is preferable. Challenges include gesture fatigue, the need for calibration to diverse body types and motor abilities, and ensuring gestures are culturally appropriate.
Category: interaction design · assistive technology · motor accessibility
Related: Motion capture · Tangible interaction · Motor control · Adaptive interface · Pose estimation