User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse




Book Chapter

Modeling multisensory integration

There are no MPG-Authors available
Fulltext (public)
There are no public fulltexts stored in PuRe
Supplementary Material (public)
There is no public supplementary material available

Van Dam, L., Parise, C., & Ernst, M. (2014). Modeling multisensory integration. In D. Bennett, & C. Hill (Eds.), Sensory Integration and the Unity of Consciousness (pp. 209-230). Cambridge, MA, USA: MIT Press.

Cite as: http://hdl.handle.net/11858/00-001M-0000-0027-80C3-7
The different senses, such as vision, touch, or audition, often provide redundant information for perceiving our environment. For instance, the size of an object can be determined by both sight and touch. In this chapter, Loes C.J. van Dam, Cesare V Parise, and Marc Ernst discuss the statistical optimal framework for combining redundant sensory information to maximize perceptual precision – the Maximum Likelihood Estimation (MLE) framework – and provides examples on how human performance approaches optimality. In the MLE framework, each cue is weighed according to its precision, that is, the more precise sensory estimate receives a higher weight when integration occurs. However, before integrating multisensory information, the perceptual system needs to determine whether or not the sensory signals correspond to the same object or event (the so-called correspondence problem). Current ideas on how the perceptual system solves the correspondence problem are provided in the same mathematical framework. Additionally, the chapter briefly reviews learning and developmental influences on multisensory integration.