English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Integration of Visual and Auditory Stimuli in the Perception of Emotional Expression in Virtual Characters

Volkova, E., Linkenauger, S., Alexandrova, I., Bülthoff, H., & Mohler, B. (2011). Integration of Visual and Auditory Stimuli in the Perception of Emotional Expression in Virtual Characters. Poster presented at 34th European Conference on Visual Perception, Toulouse, France.

Item is

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Volkova, E1, 2, Author              
Linkenauger, S1, 2, Author              
Alexandrova, I1, 2, Author              
Bülthoff, HH1, 2, Author              
Mohler, B1, 2, Author              
Affiliations:
1Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497797              
2Max Planck Institute for Biological Cybernetics, Max Planck Society, Spemannstrasse 38, 72076 Tübingen, DE, ou_1497794              

Content

show
hide
Free keywords: -
 Abstract: Virtual characters are a potentially valuable tool for creating stimuli for research investigating the perception of emotion. We conducted an audio-visual experiment to investigate the effectiveness of our stimuli to convey the intended emotion. We used dynamic virtual faces in addition to pre-recorded (Burkhardt et al, 2005, Interspeech'2005, 1517–1520) and synthesized speech to create audio-visual stimuli which conveyed all possible combinations of stimuli. Each voice and face stimuli aimed to express one of seven different emotional categories. The participants made judgments of the prevalent emotion. For the pre-recorded voice, the vocalized emotion influenced participants’ emotion judgment more than the facial expression. However, for the synthesized voice, facial expression influenced participants’ emotion judgment more than vocalized emotion. While participants rather accurately labeled (>76) the stimuli when face and voice emotion were the same, they performed worse overall on correctly identifying the stimuli when the voice was synthesized. We further analyzed the difference between the emotional categories in each stimulus and found that valence distance in the emotion of the face and voice significantly impacted recognition of the emotion judgment for both natural and synthesized voices. This experimental design provides a method to improve virtual character emotional expression.

Details

show
hide
Language(s):
 Dates: 2011-09
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: BibTex Citekey: VolkovaLABM2011
DOI: 10.1177/03010066110400S102
 Degree: -

Event

show
hide
Title: 34th European Conference on Visual Perception
Place of Event: Toulouse, France
Start-/End Date: 2011-08-28 - 2011-09-01

Legal Case

show

Project information

show

Source 1

show
hide
Title: Perception
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: London : Pion Ltd.
Pages: - Volume / Issue: 40 (ECVP Abstract Supplement) Sequence Number: - Start / End Page: 138 Identifier: ISSN: 0301-0066
CoNE: https://pure.mpg.de/cone/journals/resource/954925509369