A tutorial on partially observable Markov decision processes

DOI10.1016/j.jmp.2009.01.005zbMath1176.90298MaRDI QIDQ1042307

Michael L. Littman

Publication date: 7 December 2009

Published in: Journal of Mathematical Psychology (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.jmp.2009.01.005

zbMATH Keywords

Markov processes; POMDP; planning under uncertainty

Mathematics Subject Classification ID

90B50: Management decision making, including multiple objectives

Related Items

Theoretical tools for understanding and aiding dynamic decision making, Learning in noise: dynamic decision-making in a variable environment, A review of operations research models in invasive species management: state of the art, challenges, and future directions, Balancing control: a Bayesian interpretation of habitual and goal-directed behavior, Integral control for population management

Uses Software

• POMDPS

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Planning and acting in partially observable stochastic domains
• A survey of solution techniques for the partially observed Markov decision process
• Optimal control of Markov processes with incomplete state information
• A survey of algorithmic methods for partially observed Markov decision processes
• State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms
• The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs
• The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
• Solution Procedures for Partially Observed Markov Decision Processes
• The Complexity of Decentralized Control of Markov Decision Processes