English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions

Holle, H., Obleser, J., Rueschemeyer, S.-A., & Gunter, T. C. (2010). Integration of iconic gestures and speech in left superior temporal areas boosts speech comprehension under adverse listening conditions. NeuroImage, 49(1), 875-884. doi:10.1016/j.neuroimage.2009.08.058.

Item is

Files

show Files
hide Files
:
Holle_2010.pdf (Preprint), 2MB
Name:
Holle_2010.pdf
Description:
-
OA-Status:
Green
Visibility:
Public
MIME-Type / Checksum:
application/pdf / [MD5]
Technical Metadata:
Copyright Date:
-
Copyright Info:
-

Locators

show

Creators

show
hide
 Creators:
Holle, Henning1, Author
Obleser, Jonas2, Author           
Rueschemeyer, Shirley-Ann3, Author
Gunter, Thomas C.2, Author           
Affiliations:
1University of Sussex, Department of Psychology, Falmer, Brighton, United Kingdom, ou_persistent22              
2Department Neuropsychology, MPI for Human Cognitive and Brain Sciences, Max Planck Society, ou_634551              
3Donders Centre for Cognition, Radboud University, Nijmegen, the Netherlands, ou_persistent22              

Content

show
hide
Free keywords: Audiovisual; fMRI; Inverse effectiveness; Language; Multisensory
 Abstract: Iconic gestures are spontaneous hand movements that illustrate certain contents of speech and, as such, are an important part of face-to-face communication. This experiment targets the brain bases of how iconic gestures and speech are integrated during comprehension. Areas of integration were identified on the basis of two classic properties of multimodal integration, bimodal enhancement and inverse effectiveness (i.e., greater enhancement for unimodally least effective stimuli). Participants underwent fMRI while being presented with videos of gesture-supported sentences as well as their unimodal components, which allowed us to identify areas showing bimodal enhancement. Additionally, we manipulated the signal-to-noise ratio of speech (either moderate or good) to probe for integration areas exhibiting the inverse effectiveness property. Bimodal enhancement was found at the posterior end of the superior temporal sulcus and adjacent superior temporal gyrus (pSTS/STG) in both hemispheres, indicating that the integration of iconic gestures and speech takes place in these areas. Furthermore, we found that the left pSTS/STG specifically showed a pattern of inverse effectiveness, i.e., the neural enhancement for bimodal stimulation was greater under adverse listening conditions. This indicates that activity in this area is boosted when an iconic gesture accompanies an utterance that is otherwise difficult to comprehend. The neural response paralleled the behavioral data observed. The present data extends results from previous gesture-speech integration studies in showing that pSTS/STG plays a key role in the facilitation of speech comprehension through simultaneous gestural input. Crown Copyright © 2009.

Details

show
hide
Language(s): eng - English
 Dates: 2009-05-212009-08-272009-09-042010-01-01
 Publication Status: Issued
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: eDoc: 458459
DOI: 10.1016/j.neuroimage.2009.08.058
PMID: 20004613
 Degree: -

Event

show

Legal Case

show

Project information

show hide
Project name : -
Grant ID : -
Funding program : -
Funding organization : Max Planck Society (MPG)
Project name : -
Grant ID : Az. 11/82 175
Funding program : -
Funding organization : Volkswagenstiftung
Project name : -
Grant ID : RES-062-23-1150
Funding program : -
Funding organization : Economic & Social Research Council (ESRC)

Source 1

show
hide
Title: NeuroImage
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: Orlando, FL : Academic Press
Pages: - Volume / Issue: 49 (1) Sequence Number: - Start / End Page: 875 - 884 Identifier: ISSN: 1053-8119
CoNE: https://pure.mpg.de/cone/journals/resource/954922650166