Cross-Modal Perception

The neural and perceptual integration of information arriving through two or more sensory channels — such as vision, hearing, touch, and proprioception — into a coherent experience of the world. Cross-modal perception explains phenomena such as the McGurk effect, tactile-auditory binding, and the enhancement of object recognition when consistent information arrives through multiple senses. In accessibility, cross-modal perception provides the theoretical basis for sensory substitution devices (visual-to-auditory, visual-to-tactile), multimodal interfaces that pair screen readers with haptics, and audio-description conventions that align speech with visual timing. Congruent cross-modal cues generally improve perception and memory; poorly aligned ones can impair both.