Multimodal Sensing

The simultaneous capture of data through multiple sensor channels - for example, combining physiological signals (heart rate, galvanic skin response, skin temperature) with behavioural signals (motion, audio, button input, pressure) - to produce a richer picture of a user's state than any single channel can. In accessibility research, multimodal sensing is used for engagement recognition, affect detection, and adaptive interaction, particularly in contexts where overt behavioural cues alone may be ambiguous, such as developmental disability or assistive-technology use.