Markov Decision Processes with Imprecise Transition Probabilities

DOI10.1287/OPRE.42.4.739MaRDI QIDQ4319762zbMATH OpenOpenAlexFDO

Authors Chelsea C. White, Hany K. El-Deib

Publication date 6 February 1995

Published in Operations Research (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1287/opre.42.4.739

zbMATH Keywords

discounted Markov decision processesmodified policy iterationsuccessive approximation

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Multistage and repeated games (91A20)

Recommendations

• Generalizing Markov decision processes to imprecise probabilities
• Partially observable Markov decision processes with imprecise parameters
• Markov decision processes under ambiguity
• Markov decision processes
• MARKOV DECISION PROCESSES
• scientific article; zbMATH DE number 4154239
• scientific article; zbMATH DE number 420890
• Markov decision processes
• Imprecise continuous-time Markov chains
• Markov decision processes with incomplete information and semiuniform Feller transition probabilities

Cited in

(48)

• Partially observable Markov decision processes with imprecise parameters
• Learning, risk attitude and hot stoves in restless bandit problems
• Bounded-parameter Markov decision processes
• Generalizing Markov decision processes to imprecise probabilities
• Computation of weighted sums of rewards for concurrent MDPs
• Coefficients of ergodicity for Markov chains with uncertain parameters
• Light robustness in the optimization of Markov decision processes with uncertain parameters
• Robust analysis of discounted Markov decision processes with uncertain transition probabilities
• Robust control of the multi-armed bandit problem
• A survey of decision making and optimization under uncertainty
• Stochastic revision opportunities in Markov decision problems
• An active-set strategy to solve Markov decision processes with good-deal risk measure
• Graphical models for imprecise probabilities
• Dynamic programming for deterministic discrete-time systems with uncertain gain
• Reachability analysis of uncertain systems using bounded-parameter Markov decision processes
• Partially observable Markov decision processes incorporating
• Constrained Markov decision processes with uncertain costs
• Bounded-parameter partially observable Markov decision processes: framework and algorithm
• Probabilistic Verification of Uncertain Systems Using Bounded-Parameter Markov Decision Processes
• IMPRECISE MARKOV CHAINS AND THEIR LIMIT BEHAVIOR
• Parameter Imprecision in Finite State, Finite Action Dynamic Programs
• Probabilistic opacity for Markov decision processes
• Convergence of probability measures and Markov decision models with incomplete information
• Robust adaptive routing under uncertainty
• Concurrent MDPs with Finite Markovian Policies
• scientific article; zbMATH DE number 7626790 (Why is no real title available?)
• Robust planning with incomplete domain models
• Distributionally robust optimization for sequential decision-making
• Stochastic dynamics simulation with generalized interval probability
• scientific article; zbMATH DE number 2189773 (Why is no real title available?)
• Markov decision processes
• Data-driven remanufacturing planning with parameter uncertainty
• scientific article; zbMATH DE number 7730613 (Why is no real title available?)
• Joint chance-constrained Markov decision processes
• Efficient solutions to factored MDPs with imprecise transition probabilities
• Sequential decision making with partially ordered preferences
• Using mathematical programming to solve factored Markov decision processes with imprecise probabilities
• Distributionally robust chance-constrained Markov decision processes with random payoff
• Policy gradient algorithms for robust MDPs with nonrectangular uncertainty sets
• On the sensitivity of restless bandits solutions to uncertainty in the models of the arms
• Sequential decision-making under uncertainty: a robust MDPs review
• Solution for infinite horizon double-factored Markov decision processes with application
• On the detection of Markov decision processes
• Efficient constraint generation for stochastic shortest path problems
• Solving factored MDPs using non-homogeneous partitions
• Perfect information two-person zero-sum Markov games with imprecise transition probabilities
• Real-time dynamic programming for Markov decision processes with imprecise probabilities
• Discrete time Markov chains with interval probabilities

This page was built for publication: Markov Decision Processes with Imprecise Transition Probabilities

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4319762)