English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  A Representation of Complex Movement Sequences Based on Hierarchical Spatio-Temporal Correspondence for Imitation Learning in Robotics

Ilg, W., Bakir, G., Franz, M., & Giese, M. (2003). A Representation of Complex Movement Sequences Based on Hierarchical Spatio-Temporal Correspondence for Imitation Learning in Robotics. Poster presented at 6. Tübinger Wahrnehmungskonferenz (TWK 2003), Tübingen, Germany.

Item is

Basic

show hide
Item Permalink: http://hdl.handle.net/11858/00-001M-0000-0013-DD06-1 Version Permalink: http://hdl.handle.net/21.11116/0000-0005-7B3F-C
Genre: Poster

Files

show Files

Locators

show

Creators

show
hide
 Creators:
Ilg, W, Author              
Bakir, GH1, 2, Author              
Franz, MO1, 2, Author              
Giese, M, Author              
Affiliations:
1Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497794              
2Department Empirical Inference, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497795              

Content

show
hide
Free keywords: -
 Abstract: Imitation learning of complex movements has become a popular topic in neuroscience, as well as in robotics. A number of conceptual as well as practical problems are still unsolved. One example is the determination of the aspects of movements which are relevant for imitation. Problems concerning the movement representation are twofold: (1) The movement characteristics of observed movements have to be transferred from the perceptual level to the level of generated actions. (2) Continuous spaces of movements with variable styles have to be approximated based on a limited number of learned example sequences. Therefore, one has to use representation with a high generalisation capability. We present methods for the representation of complex movement sequences that addresses these questions in the context of the imitation learning of writing movements using a robot arm with human-like geometry. For the transfer of complex movements from perception to action we exploit a learning-based method that represents complex action sequences by linear combination of prototypical examples (Ilg and Giese, BMCV 2002). The method of hierarchical spatio-temporal morphable models (HSTMM) decomposes action sequences automatically into movement primitives. These primitives are modeled by linear combinations of a small number of learned example trajectories. The learned spatio-temporal models are suitable for the analysis and synthesis of long action sequences, which consist of movement primitives with varying style parameters. The proposed method is illustrated by imitation learning of complex writing movements. Human trajectories were recorded using a commercial motion capture system (VICON). In the rst step the recorded writing sequences are decomposed into movement primitives. These movement primitives can be analyzed and changed in style by dening linear combinations of prototypes with dierent linear weight combinations. Our system can imitate writing movements of dierent actors, synthesize new writing styles and can even exaggerate the writing movements of individual actors. Words and writing movements of the robot look very natural, and closely match the natural styles. These preliminary results makes the proposed method promising for further applications in learning-based robotics. In this poster we focus on the acquisition of the movement representation (identication and segmentation of movement primitives, generation of new writing styles by spatio-temporal morphing). The transfer of the generated writing movements to the robot considering the given kinematic and dynamic constraints is discussed in Bakir et al (this volume).

Details

show
hide
Language(s):
 Dates: 2003-02
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: BibTex Citekey: 2076
 Degree: -

Event

show
hide
Title: 6. Tübinger Wahrnehmungskonferenz (TWK 2003)
Place of Event: Tübingen, Germany
Start-/End Date: 2003-02-21 - 2003-02-23

Legal Case

show

Project information

show

Source 1

show
hide
Title: 6. Tübinger Wahrnehmungskonferenz: Sixth Perception Conference at Tübingen, TWK 2003
Source Genre: Proceedings
 Creator(s):
Bülthoff, HH1, Editor            
Gegenfurtner, KR, Editor            
Mallot, HA, Editor            
Ulrich, R, Editor
Wichmann, FA1, Editor            
Affiliations:
1 Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497794            
Publ. Info: Kirchentellinsfurt, Germany : Knirsch
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 74 Identifier: ISBN: 3-927091-62-6