Help Privacy Policy Disclaimer
  Advanced SearchBrowse


  Haptic Exploration Behavior During Bimodal Object Recognition

Newell, F., Lange, C., Bülthoff, H., & Ernst, M. (2006). Haptic Exploration Behavior During Bimodal Object Recognition. Poster presented at 9th Tübingen Perception Conference (TWK 2006), Tübingen, Germany.

Item is


show Files




Newell, FN, Author           
Lange, C1, 2, Author           
Bülthoff, HH1, 2, Author           
Ernst, MO1, 2, Author           
1Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497797              
2Max Planck Institute for Biological Cybernetics, Max Planck Society, Spemannstrasse 38, 72076 Tübingen, DE, ou_1497794              


Free keywords: -
 Abstract: For the purpose of object recognition, the combination of complementary information derived from the different sensory systems (vision and touch) should result in a rich representation of
the object in memory and may consequently enhance recognition performance.
The purpose of this study is to investigate the haptic exploration behavior during bimodal
object recognition. Specifically, we asked whether the exploration behavior for recognition
depends on what modality was used during learning of an object.
Analog to [1], we designed an old/new object recognition task using novel objects built
each from 6 Lego bricks. In each condition subjects had to learn 4 novel object shapes either
haptically (H), visually (V), or combined haptically and visually (VH). In a following recognition
phase we added 4 distractor objects and subjects had to decide whether the presented
object was known (old) or unknown (new) from the learning phase. The recognition phase was
always bimodal (VH).
We tested 12 subjects in all three conditions (V-to-VH, H-to-VH, VH-to-VH) measuring
recognition performance. Subjects exploration behavior was recorded using video tape. For
technical reasons, the recordings of only 8 subjects was used for the video analysis. Therefore,
the video was cut into single clips each showing the exploration of one stimulus. These clips
were replayed in randomized order to raters, who judged the ‘hapticallity’ of subjects’ exploration
behavior on a scale with 9 possible answers between ‘subject just held and turned the
stimulus’ to ‘subject explored the stimulus with fingers’. We found ‘hapticallity’ during visualhaptic
recognition was judged largest for the exploration following haptic learning (H-to-VH),
smallest for the one following visual learning (V-to-VH), and intermediate for visuo-haptic
learning (VH-to-VH).
This suggests that subjects use a strategy when recognizing the objects in a way that they
match the exploration behavior between learning and recognition test. They use the haptic
modality for recognition when the object was learned haptically. When the object was learned
visually they predominantly use the visual modality during recognition ignoring touch. Also
when the object was learned bimodally (VH), the exploration strategy was matched between
learning and recognition test here indicating that the haptic modality was used almost exclusively
for actively manipulating the object but not for exploring its shape.


 Dates: 2006-03
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: BibTex Citekey: 4832
 Degree: -


Title: 9th Tübingen Perception Conference (TWK 2006)
Place of Event: Tübingen, Germany
Start-/End Date: 2006-03-03 - 2006-03-05

Legal Case


Project information


Source 1

Title: 9th Tübingen Perception Conference: TWK 2006
Source Genre: Proceedings
Bülthoff, HH1, Editor           
Gillner, S, Editor           
Mallot, HA, Editor           
Ulrich, R, Editor
1 Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497794            
Publ. Info: Kirchentellinsfurt, Germany : Knirsch
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 79 Identifier: ISBN: 3-927091-73-1