On the worst-case analysis of temporal-difference learning algorithms

DOI10.1007/BF00114725MaRDI QIDQ1911342zbMATH OpenOpenAlexFDO

Authors Robert E. Schapire, Manfred K. Warmuth

Publication date 21 April 1996

Published in Machine Learning (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/bf00114725

zbMATH Keywords

learning algorithmsSutton's method of temporal differences

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• On the worst-case analysis of temporal-difference learning algorithms
• Relative loss bounds for temporal-difference learning
• Linear least-squares algorithms for temporal difference learning
• Linear least-squares algorithms for temporal difference learning
• The convergence of \(TD(\lambda)\) for general \(\lambda\)

Cites work

• scientific article; zbMATH DE number 1263196 (Why is no real title available?)
• Matrix Analysis
• On the Convergence of Stochastic Iterative Dynamic Programming Algorithms
• The convergence of \(TD(\lambda)\) for general \(\lambda\)

Cited in

(10)

• On average versus discounted reward temporal-difference learning
• On-line learning on temporal manifolds
• Scalable estimation strategies based on stochastic approximations: classical results and new insights
• Asymptotic analysis of temporal-difference learning algorithms with constant step-sizes
• Chaotic dynamics and convergence analysis of temporal difference algorithms with bang-bang control
• Is Temporal Difference Learning Optimal? An Instance-Dependent Analysis
• On the worst-case analysis of temporal-difference learning algorithms
• Linear least-squares algorithms for temporal difference learning
• True online temporal-difference learning
• A finite time analysis of temporal difference learning with linear function approximation

This page was built for publication: On the worst-case analysis of temporal-difference learning algorithms

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1911342)