Help Privacy Policy Disclaimer
  Advanced SearchBrowse




Meeting Abstract

See what you hear: Constructing a representation of the world across the senses

There are no MPG-Authors in the publication available
Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)
There are no public fulltexts stored in PuRe
Supplementary Material (public)
There is no public supplementary material available

Noppeney, U., & Rohe, T. (2016). See what you hear: Constructing a representation of the world across the senses. Journal of Cognitive Neuroscience, (Supplement), 32.

Cite as: https://hdl.handle.net/21.11116/0000-0000-7CF6-0
Our brains are continuously confronted with the problem of how to understand the sensory signals with which they are bombarded. For example, I can hear a bird and I can see a bird, but is it one bird singing on the branch, or is it two birds: one sitting on the branch and the other singing in the bush? How should the brain combine signals into a veridical percept of the environment without knowing whether they pertain to same or different events? Combining Bayesian Modelling with fMRI and EEG multivariate decoding we investigated how the brain solves this so-called Causal Inference problem. We demonstrate that the human brain integrates sensory signals into spatial representations in line with Bayesian Causal Inference by simultaneously encoding multiple spatial estimates along the cortical hierarchy. Critically, only at the top of the hierarchy, in anterior intraparietal sulcus, the uncertainty about the world’s causal structure is taken into account and sensory signals are integrated weighted by their bottom-up sensory reliability and top-down task-relevance into spatial priority maps as predicted by Bayesian Causal Inference. Characterizing the computational operations of multisensory interactions in human neocortex reveals the hierarchical nature of multisensory perception.