English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Meeting Abstract

The time course of multimodal percepts induced by reliability changes

MPS-Authors
/persons/resource/persons83885

Di Luca,  M
Research Group Multisensory Perception and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society;
Max Planck Institute for Biological Cybernetics, Max Planck Society;

/persons/resource/persons83906

Ernst,  M
Research Group Multisensory Perception and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society;
Max Planck Institute for Biological Cybernetics, Max Planck Society;

Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)
There are no public fulltexts stored in PuRe
Supplementary Material (public)
There is no public supplementary material available
Citation

Di Luca, M., & Ernst, M. (2007). The time course of multimodal percepts induced by reliability changes. In 8th International Multisensory Research Forum (IMRF 2007).


Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-CD41-7
Abstract
A desirable goal in combining multimodal information is to maximize the reliability of the percept. This may be done using optimal strategies, where unimodal signals are weighted by their relative reliabilities. In real-world situations, stimulus conditions frequently change and with that the reliability of the signals. Here we ask whether the system takes such changes in reliability into account by adjusting the weights online in the McGurk effect.
Subjects were presented with an audiovisual recording of an actors’ face producing a series of syllables. Such syllables were composed either by consistent multimodal information, or by an auditory /ba/ and a lip movement of /ga/. Subjectsamp;amp;amp;amp;amp;amp;lsquo; task was to continuously report which syllable they perceived. We varied the reliability of the visual information by changing the visibility of the face.
With inconsistent multimodal information, we found that increased reliability of the visual signal biased perception towards the illusory /da/ percept whereas decreased reliability biased perception towards the auditory /ba/. However, changes in reliability had perceptual consequences only after a delay of 3-4 seconds. From this we concluded that the reliability estimate of the sensory signals is not instantaneous but continuously updated with a time constant of a few seconds.
FP6 EC project ImmerSence (IST-2006-02714)