English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Gesture-speech physics in fluent speech and rhythmic upper limb movements

Pouw, W., De Jonge-Hoekstra, L., Harrison, S. J., Paxton, A., & Dixon, J. A. (2021). Gesture-speech physics in fluent speech and rhythmic upper limb movements. Annals of the New York Academy of Sciences, 1491(1), 89-105. doi:10.1111/nyas.14532.

Item is

Basic

show hide
Genre: Journal Article

Files

show Files
hide Files
:
Pouw_etal_2021_Gesture speech physics in fluent speech and rhythmic upper limb movements.pdf (Publisher version), 3MB
Name:
Pouw_etal_2021_Gesture speech physics in fluent speech and rhythmic upper limb movements.pdf
Description:
-
Visibility:
Public
MIME-Type / Checksum:
application/pdf / [MD5]
Technical Metadata:
Copyright Date:
2020
Copyright Info:
© 2020 The Authors. Annals of the New York Academy of Sciences published by Wiley Periodicals LLC on behalf of New York Academy of Sciences This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Locators

show
hide
Locator:
data and analyses (Supplementary material)
Description:
-

Creators

show
hide
 Creators:
Pouw, Wim1, 2, 3, 4, Author              
De Jonge-Hoekstra, Lisette4, 5, Author
Harrison, Steven J.4, Author
Paxton, Alexandra4, Author
Dixon, James A.4, Author
Affiliations:
1Donders Institute for Brain, Cognition and Behaviour, External Organizations, ou_55236              
2Other Research, MPI for Psycholinguistics, Max Planck Society, Nijmegen, NL, ou_55217              
3Multimodal Language and Cognition, Radboud University Nijmegen, External Organizations, ou_3055480              
4University of Connecticut, Storrs, CT, USA, ou_persistent22              
5University of Groningen, Groningen, The Netherlands, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: Communicative hand gestures are often coordinated with prosodic aspects of speech, and salient moments of gestural movement (e.g., quick changes in speed) often co-occur with salient moments in speech (e.g., near peaks in fundamental frequency and intensity). A common understanding is that such gesture and speech coordination is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech movements has been identified as a potentially important factor in understanding the emergence of gesture-speech coordination. Specifically, in the case of steady-state vocalization and mono-syllable utterances, forces produced during gesturing are transferred onto the tensioned body, leading to changes in respiratory-related activity and thereby affecting vocalization F0 and intensity. In the current experiment (N = 37), we extend this previous line of work to show that gesture-speech physics impacts fluent speech, too. Compared with non-movement, participants who are producing fluent self-formulated speech, while rhythmically moving their limbs, demonstrate heightened F0 and amplitude envelope, and such effects are more pronounced for higher-impulse arm versus lower-impulse wrist movement. We replicate that acoustic peaks arise especially during moments of peak-impulse (i.e., the beat) of the movement, namely around deceleration phases of the movement. Finally, higher deceleration rates of higher-mass arm movements were related to higher peaks in acoustics. These results confirm a role for physical-impulses of gesture affecting the speech system. We discuss the implications of gesture-speech physics for understanding of the emergence of communicative gesture, both ontogenetically and phylogenetically.

Details

show
hide
Language(s): eng - English
 Dates: 2020-12-182021-05
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: Peer
 Identifiers: DOI: 10.1111/nyas.14532
 Degree: -

Event

show

Legal Case

show

Project information

show

Source 1

show
hide
Title: Annals of the New York Academy of Sciences
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: New York : New York Academy of Sciences
Pages: - Volume / Issue: 1491 (1) Sequence Number: - Start / End Page: 89 - 105 Identifier: ISSN: 0077-8923
CoNE: https://pure.mpg.de/cone/journals/resource/954926958894_2