Multisensory perception research figure
Multisensory perception studies how uncertain signals are combined across senses, context, and action.

Multisensory Perception

How the brain combines uncertain signals during perception and action

Multisensory perception studies how people infer the state of the world from signals that are useful but imperfect. Vision, touch, audition, and proprioception each carry partial information, and the brain must decide when signals belong together, how reliable they are, and how they should influence perception and action.

The work spans cue integration, visual-haptic perception, body ownership, spatial perception, depth, material appearance, object shape, and crossmodal timing. It treats perception as a process of interpretation under uncertainty: sensory signals are noisy, sometimes ambiguous, and often affected by movement, context, prior experience, and recent adaptation.

This topic connects basic perceptual science with technology design. Understanding how multisensory signals are combined helps explain why delayed visual feedback can change perceived stiffness, why a virtual hand can feel more or less like one’s own, why synchrony matters for integration, and how XR and haptic systems can be made more intelligible by respecting perceptual constraints.

Key Questions

When does the brain treat signals from different senses as evidence about the same event?
How are uncertain visual, tactile, auditory, and proprioceptive cues weighted during perception and action?
How do synchrony, delay, context, and prior experience reshape multisensory integration?
What can multisensory science tell us about body ownership, XR interaction, and haptic design?

Related Keywords

Portfolio and Resources

Featured Publications

(2023). Touching with the eyes: oculomotor self-touch induces illusory body ownership. iScience.

PDF Cite DOI

(2021). Systems and methods for delivering a plurality of haptic effects.

PDF Cite Project

Articles in multisensory perception 31

(2023). Touching with the eyes: oculomotor self-touch induces illusory body ownership. iScience.

PDF Cite DOI

(2021). Systems and methods for delivering a plurality of haptic effects.

PDF Cite Project

(2021). Tactile Echoes: Multisensory Augmented Reality for the Hand. IEEE Transactions on Haptics.

PDF Cite Dataset Video DOI

(2020). Causality shifts the perceived temporal order of audiovisual events.. Journal of Experimental Psychology: Human Perception and Performance.

PDF Cite DOI

(2020). Methods, devices, and systems for creating localized haptic stimulations on a user.

PDF Cite Code Project

(2019). Virtual grasping feedback and virtual hand ownership. Proceedings - SAP 2019: ACM Conference on Applied Perception.

PDF Cite Project DOI

(2019). Perceptual Limits of Visual-Haptic Simultaneity in Virtual Reality Interactions. 2019 IEEE World Haptics Conference (WHC).

PDF Cite Project Slides Video DOI

(2018). Modality-specific temporal constraints for state-dependent interval timing. Scientific Reports.

PDF Cite Project DOI

(2018). Peri-personal space as a prior in coupling visual and proprioceptive signals. Scientific Reports.

PDF Cite Project DOI

(2018). Touch with foreign hands: The effect of virtual hand appearance on visual-haptic integration. Proceedings - SAP 2018: ACM Symposium on Applied Perception.

PDF Cite Project DOI

(2016). The Consistency of Crossmodal Synchrony Perception Across the Visual, Auditory, and Tactile Senses. Journal of Experimental Psychology: Human Perception and Performance.

PDF Cite DOI

(2016). Depth: The Forgotten Dimension in Multisensory Research. Multisensory Research.

PDF Cite Project DOI

(2014). Computational aspects of softness perception. Multisensory softness.

Cite Project DOI

(2014). Multisensory Softness. Springer London.

Cite Project DOI

(2014). Duration perception in crossmodally-defined intervals. Acta Psychologica.

PDF Cite DOI

(2013). Multisensory contributions to spatial perception. Handbook of Spatial Cognition.

PDF Cite Project DOI

(2012). Multisensory simultaneity recalibration: storage of the aftereffect in the absence of counterevidence. Experimental Brain Research.

PDF Cite Project DOI

(2012). Multisensory Perception: From Integration to Remapping. Sensory Cue Integration.

PDF Cite DOI

(2011). Effects of visual-haptic asynchronies and loading-unloading movements on compliance perception. Brain Research Bulletin.

PDF Cite Project DOI

(2011). Audiovisual asynchrony detection in human speech.. Journal of experimental psychology. Human perception and performance.

PDF Cite DOI

(2010). Within- and cross-modal distance information disambiguate visual size-change perception. PLoS Computational Biology.

PDF Cite DOI

(2010). Inconsistency of perceived 3D shape. Vision Research.

Cite DOI

(2009). Influence of visual and haptic delays on stiffness perception in augmented reality. Science and Technology Proceedings - IEEE 2009 International Symposium on Mixed and Augmented Reality, ISMAR 2009.

PDF Cite DOI

(2009). Recalibration of multisensory simultaneity: Cross-modal transfer coincides with a change in perceptual latency. Journal of Vision.

PDF Cite DOI

(2007). Temporal calibration between the visual, auditory, and tactile senses: A psychophysical approach. Peach Summer School 2007.

PDF Cite

(2007). The relation between disparity and velocity signals of rigidly moving objects constrains depth order perception. Vision Research.

Cite DOI

Related Research Areas

Massimiliano Di Luca
Massimiliano Di Luca
Associate Professor in Psychology and Computer Science

Associate Professor in Psychology and Computer Science at the University of Birmingham, leading interdisciplinary research in multisensory perception, extended reality, haptics, and computational cognitive science.