Gesture sonification

The technique of converting touchscreen finger movements into real-time audio representations by mapping spatial position to sound parameters — typically pitch for vertical position and stereo panning for horizontal position. Gesture sonification enables blind and visually impaired users to perceive and learn touchscreen gestures non-visually by hearing the spatial trajectory, speed, and timing of a gesture as it is performed. Research shows that pitch+stereo panning is the most effective parameter combination, and that sonification is particularly valuable for conveying continuous properties like speed and shape closure that verbal descriptions cannot easily communicate.