User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse


  Classification and Memory Behaviour of Man Revisited by Machine

Graf, A., Wichmann, F., Bülthoff, H., & Schölkopf, B. (2004). Classification and Memory Behaviour of Man Revisited by Machine. Poster presented at Computational and Systems Neuroscience Meeting (COSYNE 2004), Cold Spring Harbor, NY, USA.

Item is


show hide
Item Permalink: http://hdl.handle.net/11858/00-001M-0000-0013-D9B9-B Version Permalink: http://hdl.handle.net/21.11116/0000-0005-6502-7
Genre: Poster


show Files




Graf, ABA1, 2, 3, Author              
Wichmann, FA1, 3, Author              
Bülthoff, HH2, 3, Author              
Schölkopf, B1, 3, Author              
1Department Empirical Inference, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497795              
2Department Human Perception, Cognition and Action, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497797              
3Max Planck Institute for Biological Cybernetics, Max Planck Society, Spemannstrasse 38, 72076 Tübingen, DE, ou_1497794              


Free keywords: -
 Abstract: The main aim of this study is to unravel the mechanisms responsible for classification and memorization of visual stimuli in the human brain using methods from machine learning. We perform a visual gender discrimination task of images from a human face database. Man and machine are studied using an embedded feedback loop methodology as explained below. In a first classification experiment the human subjects are asked to classify faces from a subset of the database according to their gender. Their responses, i.e. estimated gender, reaction time and confidence rating are recorded. The gender estimated by the subject together with a low-dimensional representation obtained using Principal Component Analysis of the presented stimuli then form the subject’s personal dataset. On this dataset, various linear separating hyperplane algorithms obtained from machine learning, Support Vector Machines, Relevance Vector Machines, mean-of-class prototype learners and K-means clustering combined with a nearest-neigbour classifier, are trained. The separating hyperplane (SH) is then computed for each of these algorithms using a possibly sparse subset of the subject’s dataset: the representations. We observe that stimuli far from the SH are classified more accurately, faster and with higher confidence than those near to the SH. A new dataset, consisting of stimuli drawn from the representations, from the dataset seen by the subject and from a subset of the database which has not been presented to the subject is created on-line. In a subsequent memory experiment the subject is asked to classify the stimuli from this dataset as seen or unseen in the first classification experiment. This step actually constitutes the feedback loop: the results of the subject are used by the machine to create a novel set of stimuli which are then presented to the subject. Here we assess the usefulness of the representations given by the learning algorithms by studying whether a given representation was actually useful for man during classification. In this case we assume this representation to be activated during classification and thus possibly memorized better and hence recognized when presented a second time. Finally, in the second classification experiment, the subject is asked to perform a gender classification experiment identical to the first one, except that all the stimuli from the database and all the representations are presented. This experiment allows to verify the essential assumption that the internal representation of the faces in the subjects is stable and, if not, to see whether the “unstable” ones lie close to the SH of one of the algorithms.


 Dates: 2004-03
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Method: -
 Identifiers: BibTex Citekey: 2632
 Degree: -


Title: Computational and Systems Neuroscience Meeting (COSYNE 2004)
Place of Event: Cold Spring Harbor, NY, USA
Start-/End Date: 2004-03-24 - 2004-03-28

Legal Case


Project information


Source 1

Title: Computational and Systems Neuroscience Meeting (COSYNE 2004)
Source Genre: Proceedings
Brody, C, Editor
Pouge, A, Editor
Shadlen, M, Editor
Zador, A, Editor
Publ. Info: Cold Spring Harbor, NY, USA : Cold Spring Harbor Laboratory
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 72 Identifier: -