What does cross-linguistic variation in semantic coordination of speech and 
gesture reveal? Evidence for an interface representation of spatial thinking 
and speaking

Kita, Sotaro; Ozyurek, Asli

doi:10.1016/S0749-596X(02)00505-3

アイテム詳細

登録内容を編集ファイル形式で保存

一時保存へ追加

タグ情報を表示リリース履歴を表示詳細要約

公開

学術論文

What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking

MPS-Authors

Kita, Sotaro
Language and Cognition Group, MPI for Psycholinguistics, Max Planck Society;
Space, MPI for Psycholinguistics, Max Planck Society;

/persons/resource/persons142

Ozyurek, Asli
Language and Cognition Group, MPI for Psycholinguistics, Max Planck Society;
Space, MPI for Psycholinguistics, Max Planck Society;

External Resource

There are no locators available

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

フルテキスト (公開)

Kita_2003_what does.pdf
(出版社版), 378KB

付随資料 (公開)

There is no public supplementary material available

引用

Kita, S., & Ozyurek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48(1), 16-32. doi:10.1016/S0749-596X(02)00505-3.

引用: https://hdl.handle.net/11858/00-001M-0000-0013-1ED2-4

要旨

Gestures that spontaneously accompany speech convey information coordinated with the concurrent speech. There has been considerable theoretical disagreement about the process by which this informational coordination is achieved. Some theories predict that the information encoded in gesture is not influenced by how information is verbally expressed. However, others predict that gestures encode only what is encoded in speech. This paper investigates this issue by comparing informational coordination between speech and gesture across different languages. Narratives in Turkish, Japanese, and English were elicited using an animated cartoon as the stimulus. It was found that gestures used to express the same motion events were influenced simultaneously by (1) how features of motion events were expressed in each language, and (2) spatial information in the stimulus that was never verbalized. From this, it is concluded that gestures are generated from spatio-motoric processes that interact on-line with the speech production process. Through the interaction, spatio-motoric information to be expressed is packaged into chunks that are verbalizable within a processing unit for speech formulation. In addition, we propose a model of speech and gesture production as one of a class of frameworks that are compatible with the data.