Bounded-parameter partially observable Markov decision processes: framework and algorithm

DOI10.1142/S0218488513500396zbMATH Open1321.91027OpenAlexW2118538898MaRDI QIDQ2948867FDOQ2948867

Authors Yaodong Ni, Zhiqiang Liu 

Publication date 6 October 2015

Published in International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1142/s0218488513500396

zbMATH Keywords

decision making under uncertaintyplanning under uncertaintybounded-parameter POMDPmodified value iterationULVI algorithm

Mathematics Subject Classification ID

Decision theory (91B06) Markov and semi-Markov decision processes (90C40)

Recommendations

• Policy iteration for bounded-parameter POMDPs
• Partially observable Markov decision processes with imprecise parameters
• Bounded-parameter Markov decision processes
• Computationally Feasible Bounds for Partially Observed Markov Decision Processes
• scientific article; zbMATH DE number 1509479

Cites work

• A survey of algorithmic methods for partially observed Markov decision processes
• Bounded-parameter Markov decision processes
• Computationally Feasible Bounds for Partially Observed Markov Decision Processes
• Efficient solutions to factored MDPs with imprecise transition probabilities
• Generalizing Markov decision processes to imprecise probabilities
• Markov Decision Processes with Imprecise Transition Probabilities
• Markovian Decision Processes with Uncertain Transition Probabilities
• Parameter Imprecision in Finite State, Finite Action Dynamic Programs
• Partially observable Markov decision processes with imprecise parameters
• Percentile Optimization for Markov Decision Processes with Parameter Uncertainty
• Planning and acting in partially observable stochastic domains
• Policy iteration for bounded-parameter POMDPs
• State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms
• The Optimal Control of Partially Observable Markov Processes over a Finite Horizon
• The Optimal Control of Partially Observable Markov Processes over the Infinite Horizon: Discounted Costs

Cited in

(8)

• A survey of solution techniques for the partially observed Markov decision process
• Bounded-parameter Markov decision processes
• Parameter-Independent Strategies for pMDPs via POMDPs
• Optimality guarantees for particle belief approximation of POMDPs
• Policy iteration for bounded-parameter POMDPs
• Elaboration Tolerant Representation of Markov Decision Process via Decision-Theoretic Extension of Probabilistic Action Language +
• Partially observable Markov decision processes with imprecise parameters
• A survey of decision making and optimization under uncertainty

This page was built for publication: Bounded-parameter partially observable Markov decision processes: framework and algorithm

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2948867)