Help Privacy Policy Disclaimer
  Advanced SearchBrowse




Journal Article

The temporal distribution of information in audiovisual spoken-word identification


Jesse,  Alexandra
Language Comprehension Group, MPI for Psycholinguistics, Max Planck Society;
Mechanisms and Representations in Comprehending Speech, MPI for Psycholinguistics, Max Planck Society;
Decoding Continuous Speech , MPI for Psycholinguistics, Max Planck Society;

External Resource
No external resources are shared
Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)

(Publisher version), 270KB

Supplementary Material (public)
There is no public supplementary material available

Jesse, A., & Massaro, D. W. (2010). The temporal distribution of information in audiovisual spoken-word identification. Attention, Perception & Psychophysics, 72(1), 209-225. doi:10.3758/APP.72.1.209.

Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-37BF-C
In the present study, we examined the distribution and processing of information over time in auditory and visual speech as it is used in unimodal and bimodal word recognition. English consonant—vowel—consonant words representing all possible initial consonants were presented as auditory, visual, or audiovisual speech in a gating task. The distribution of information over time varied across and within features. Visual speech information was generally fully available early during the phoneme, whereas auditory information was still accumulated. An audiovisual benefit was therefore already found early during the phoneme. The nature of the audiovisual recognition benefit changed, however, as more of the phoneme was presented. More features benefited at short gates rather than at longer ones. Visual speech information plays, therefore, a more important role early during the phoneme rather than later. The results of the study showed the complex interplay of information across modalities and time, since this is essential in determining the time course of audiovisual spoken-word recognition.