Perception of Prominence Intensity in audio-visual Speech

Nusseck, M; Cunningham, DW; Ruiter, JPD; Wallraven, C

アイテム詳細

登録内容を編集ファイル形式で保存

一時保存へ追加

タグ情報を表示リリース履歴を表示詳細要約

公開

会議論文

Perception of Prominence Intensity in audio-visual Speech

MPS-Authors

/persons/resource/persons84115

Nusseck, M
Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society;
Max Planck Institute for Biological Cybernetics, Max Planck Society;

/persons/resource/persons84298

Wallraven, C
Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society;
Max Planck Institute for Biological Cybernetics, Max Planck Society;

External Resource

https://avsp2007.uvt.nl/location.html
(目次)

Fulltext (restricted access)

There are currently no full texts shared for your IP range.

フルテキスト (公開)

AVSP-2007-Nusseck.pdf
(全文テキスト（全般）), 160KB

付随資料 (公開)

There is no public supplementary material available

引用

Nusseck, M., Cunningham, D., Ruiter, J., & Wallraven, C. (2007). Perception of Prominence Intensity in audio-visual Speech. In J., Vroomem, M., Swerts, & E., Krahmer (Eds.), International Conference on Auditory-Visual Speech Processing 2007 (AVSP 2007) (pp. 1-6).

引用: https://hdl.handle.net/11858/00-001M-0000-0013-CBF7-1

要旨

Multimodal prosody carries a wide variety of information Here, we investigated the roles of visual and the auditory information in the production and perception of different emphasis intensities.
In a series of video recordings, the intensity, location, and syntactic category of the emphasized word were varied. Physical analyses demonstrated that each speaker produced different emphasis intensities, with a high degree of individual variation in information distribution. In the first psychophysical experiment, observers easily distinguished between the different intensities.
Interestingly, the pattern of perceived intensity was
remarkably similar across speakers, despite the individual variations in the use of different visual and acoustic modalities. The second experiment presented the recordings visually, acoustically, and audiovisually. Overall, while the audio only condition was very similar to the audiovisual condition, there was a clear influence of visual information. Weak visual information lead to a weaker audiovisual intensity, while stong visual information
enhanced audiovisual intensity.