English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
 
 
DownloadE-Mail
 Local TagsRelease HistoryDetailsSummary
  Bayes-Adaptive Simulation-based Search with Value Function Approximation

Guez, A., Heess, N., Silver, D., & Dayan, P. (2015). Bayes-Adaptive Simulation-based Search with Value Function Approximation. In Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, & K. Weinberger (Eds.), Advances in Neural Information Processing Systems 27 (NIPS 2014) (pp. 451-459). Red Hook, NY, USA: Curran.

Item is

 

show all hide all

Basic

show hide
Item Permalink: https://hdl.handle.net/21.11116/0000-0004-BFA7-9 Version Permalink: https://hdl.handle.net/21.11116/0000-0004-BFA8-8
Genre: Conference Paper

Files

show Files

Creators

show
hide
 Creators:
Guez, A, Author
Heess, N, Author
Silver, D, Author
Dayan, P1, Author           
Affiliations:
1External Organizations, ou_persistent22              

Content

show
hide
Free keywords: -
 Abstract: Bayes-adaptive planning offers a principled solution to the exploration-exploitation trade-off under model uncertainty. It finds the optimal policy in belief space, which explicitly accounts for the expected effect on future rewards of reductions in uncertainty. However, the Bayes-adaptive solution is typically intractable in domains with large or continuous state spaces. We present a tractable method for approximating the Bayes-adaptive solution by combining simulation-based search with a novel value function approximation technique that generalises over belief space. Our method outperforms prior approaches in both discrete bandit tasks and simple continuous navigation and control tasks.

Details

show
hide
Language(s):
 Dates: 2015
 Publication Status: Issued
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: -
 Degree: -

Event

show
hide
Title: Twenty-Eighth Annual Conference on Neural Information Processing Systems (NIPS 2014)
Place of Event: Montreal, Canada
Start-/End Date: 2014-12-08 - 2014-12-13

Legal Case

show

Project information

show

Source 1

show
hide
Title: Advances in Neural Information Processing Systems 27 (NIPS 2014)
Source Genre: Proceedings
 Creator(s):
Ghahramani, Z, Editor
Welling, M, Editor
Cortes, C, Editor
Lawrence, ND, Editor
Weinberger, KQ, Editor
Affiliations:
-
Publ. Info: Red Hook, NY, USA : Curran
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 451 - 459 Identifier: ISBN: 978-1-5108-0041-0