English
 
User Manual Privacy Policy Disclaimer Contact us
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Feudal Multi-Agent Hierarchies for Cooperative Reinforcement Learning

Ahilan, S., & Dayan, P. (2019). Feudal Multi-Agent Hierarchies for Cooperative Reinforcement Learning. Poster presented at 4th Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2019), Montreal, Canada.

Item is

Basic

show hide
Item Permalink: http://hdl.handle.net/21.11116/0000-0004-7955-5 Version Permalink: http://hdl.handle.net/21.11116/0000-0004-DA00-6
Genre: Poster

Files

show Files

Locators

show
hide
Description:
-

Creators

show
hide
 Creators:
Ahilan, S, Author
Dayan, P1, 2, Author              
Affiliations:
1Department of Computational Neuroscience, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_3017468              
2Max Planck Institute for Biological Cybernetics, Max Planck Society, Spemannstrasse 38, 72076 Tübingen, DE, ou_1497794              

Content

show
hide
Free keywords: -
 Abstract: We investigate how reinforcement learning agents can learn to cooperate. Drawing inspiration from human societies, in which successful coordination of many individuals is often facilitated by hierarchical organisation, we introduce Feudal Multi-agent Hierarchies (FMH). In this framework, a ‘manager’ agent, which is tasked with maximising the environmentally-determined reward function, learns to communicate subgoals to multiple, simultaneously-operating, ‘worker’ agents. Workers, which are rewarded for achieving managerial subgoals, take concurrent actions in the world. We outline the structure of FMH and demonstrate its potential for decentralised learning and control. We find that, given an adequate set of subgoals from which to choose, FMH performs, and particularly scales, substantially better than cooperative approaches that use a shared reward function.

Details

show
hide
Language(s):
 Dates: 2019-07
 Publication Status: Published online
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Method: -
 Identifiers: -
 Degree: -

Event

show
hide
Title: 4th Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2019)
Place of Event: Montreal, Canada
Start-/End Date: 2019-07-07 - 2019-07-10

Legal Case

show

Project information

show

Source 1

show
hide
Title: 4th Multidisciplinary Conference on Reinforcement Learning and Decision Making (RLDM 2019)
Source Genre: Proceedings
 Creator(s):
Affiliations:
Publ. Info: -
Pages: - Volume / Issue: - Sequence Number: 94 Start / End Page: 57 Identifier: -