Deutsch
 
Hilfe Datenschutzhinweis Impressum
  DetailsucheBrowse

Datensatz

DATENSATZ AKTIONENEXPORT
  PAC-Bayes-Bernstein Inequality for Martingales and its Application to Multiarmed Bandits

Seldin, Y., Cesa-Bianchi, N., Auer, P., Laviolette, F., & Shawe-Taylor, J. (2012). PAC-Bayes-Bernstein Inequality for Martingales and its Application to Multiarmed Bandits. In C. Glowacka, L. Dorata, & J. Shawe-Taylor (Eds.), Workshop on On-line Trading of Exploration and Exploitation 2, 02 July 2011, Bellevue, Washington, USA (pp. 98-111). Madison, WI, USA: International Machine Learning Society.

Item is

Externe Referenzen

einblenden:
ausblenden:
Beschreibung:
-
OA-Status:

Urheber

einblenden:
ausblenden:
 Urheber:
Seldin, Y1, Autor           
Cesa-Bianchi, N, Autor
Auer, P, Autor
Laviolette, F, Autor
Shawe-Taylor, J, Autor
Affiliations:
1Dept. Empirical Inference, Max Planck Institute for Intelligent Systems, Max Planck Society, DE, ou_1497647              

Inhalt

einblenden:
ausblenden:
Schlagwörter: -
 Zusammenfassung: We develop a new tool for data-dependent analysis of the exploration-exploitation trade-off in learning under limited feedback. Our tool is based on two main ingredients. The first ingredient is a new concentration inequality that makes it possible to control the concentration of weighted averages of multiple (possibly uncountably many) simultaneously evolving and interdependent martingales. The second ingredient is an application of this inequality to the exploration-exploitation trade-off via importance weighted sampling. We apply the new tool to the stochastic multiarmed bandit problem, however, the main importance of this paper is the development and understanding of the new tool rather than improvement of existing algorithms for stochastic multiarmed bandits. In the follow-up work we demonstrate that the new tool can improve over state-of-the-art in structurally richer problems, such as stochastic multiarmed bandits with side information (Seldin et al., 2011a).

Details

einblenden:
ausblenden:
Sprache(n):
 Datum: 2012-04
 Publikationsstatus: Erschienen
 Seiten: -
 Ort, Verlag, Ausgabe: -
 Inhaltsverzeichnis: -
 Art der Begutachtung: -
 Identifikatoren: BibTex Citekey: SeldinCALS2011
 Art des Abschluß: -

Veranstaltung

einblenden:
ausblenden:
Titel: Workshop on On-line Trading of Exploration and Exploitation 2
Veranstaltungsort: Bellevue, WA, USA
Start-/Enddatum: 2011-07-02

Entscheidung

einblenden:

Projektinformation

einblenden:

Quelle 1

einblenden:
ausblenden:
Titel: Workshop on On-line Trading of Exploration and Exploitation 2, 02 July 2011, Bellevue, Washington, USA
Genre der Quelle: Konferenzband
 Urheber:
Glowacka, C, Herausgeber
Dorata, L, Herausgeber
Shawe-Taylor , J, Herausgeber
Affiliations:
-
Ort, Verlag, Ausgabe: Madison, WI, USA : International Machine Learning Society
Seiten: - Band / Heft: - Artikelnummer: - Start- / Endseite: 98 - 111 Identifikator: -

Quelle 2

einblenden:
ausblenden:
Titel: JMLR Workshop and Conference Proceedings
Genre der Quelle: Reihe
 Urheber:
Affiliations:
Ort, Verlag, Ausgabe: -
Seiten: - Band / Heft: 26 Artikelnummer: - Start- / Endseite: - Identifikator: -