English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Reinforcement Learning for Parameterized Motor Primitives

Peters, J., & Schaal, S. (2006). Reinforcement Learning for Parameterized Motor Primitives. In 2006 IEEE International Joint Conference on Neural Network Proceedings (pp. 73-80). Piscataway, NJ, USA: IEEE Service Center.

Item is

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Peters, J1, Author              
Schaal, S1, Author              
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: One of the major challenges in both action generation for robotics and in the understanding of human motor control is to learn the "building blocks of movement generation", called motor primitives. Motor primitives, as used in this paper, are parameterized control policies such as splines or nonlinear differential equations with desired attractor properties. While a lot of progress has been made in teaching parameterized motor primitives using supervised or imitation learning, the selfimprovement by interaction of the system with the environment remains a challenging problem. In this paper, we evaluate different reinforcement learning approaches for improving the performance of parameterized motor primitives. For pursuing this goal, we highlight the difficulties with current reinforcement learning methods, and outline both established and novel algorithms for the gradient-based improvement of parameterized policies. We compare these algorithms in the context of motor primitive learning, and show that our most modern algorithm, the Episodic Natural Actor-Critic outperforms previous algorithms by at least an order of magnitude. We demonstrate the efficiency of this reinforcement learning method in the application of learning to hit a baseball with an anthropomorphic robot arm.

Details

show
hide
Language(s):
 Dates: 2006-07
 Publication Status: Published in print
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: DOI: 10.1109/IJCNN.2006.246662
BibTex Citekey: 5050
 Degree: -

Event

show
hide
Title: International Joint Conference on Neural Networks (IJCNN 2006)
Place of Event: Los Angeles, CA, USA
Start-/End Date: 2006-07-16 - 2006-07-21

Legal Case

show

Project information

show

Source 1

show
hide
Title: 2006 IEEE International Joint Conference on Neural Network Proceedings
Source Genre: Proceedings
 Creator(s):
Affiliations:
Publ. Info: Piscataway, NJ, USA : IEEE Service Center
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 73 - 80 Identifier: ISBN: 0-7803-9490-9