Markovian Decision Processes with Uncertain Transition Probabilities

DOI10.1287/opre.21.3.728zbMath0286.60038OpenAlexW2069045459MaRDI QIDQ4773124

Jay K. Satia, Roy E. Jun. Lave

Publication date: 1973

Published in: Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/opre.21.3.728

Mathematics Subject Classification ID

Stochastic systems and control (93E99) Markov processes: estimation; hidden Markov models (62M05) Applications of game theory (91A80) Statistical decision theory (62C99) Markov processes (60J99)

Related Items

Stochastic dominance with imprecise information ⋮ Partially observable Markov decision processes incorporating ⋮ Graphical models for imprecise probabilities ⋮ Dynamic programming for deterministic discrete-time systems with uncertain gain ⋮ Perfect information two-person zero-sum Markov games with imprecise transition probabilities ⋮ Robust Markov Decision Processes with Data-Driven, Distance-Based Ambiguity Sets ⋮ Ranking of fuzzy intervals seen through the imprecise probabilistic lens ⋮ Constrained Markov decision processes with uncertain costs ⋮ BOUNDED-PARAMETER PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES: FRAMEWORK AND ALGORITHM ⋮ A framework for learning fuzzy rule-based models with epistemic set-valued data and generalized loss functions ⋮ Markov interval chain (MIC) for solving a decision problem ⋮ Acting on belief functions ⋮ Nonlinear desirability theory ⋮ Data-driven remanufacturing planning with parameter uncertainty ⋮ Coefficients of ergodicity for Markov chains with uncertain parameters ⋮ Real-time dynamic programming for Markov decision processes with imprecise probabilities ⋮ Joint chance-constrained Markov decision processes ⋮ The set of limiting distributions for a Markov chain with fuzzy transition probabilities ⋮ Policy iteration for bounded-parameter POMDPs ⋮ Efficient solutions to factored MDPs with imprecise transition probabilities ⋮ Sequential decision making with partially ordered preferences ⋮ Using mathematical programming to solve factored Markov decision processes with imprecise probabilities ⋮ Imprecise Probabilities and Unstable Betting Behaviour ⋮ Robust topological policy iteration for infinite horizon bounded Markov decision processes ⋮ Computation of weighted sums of rewards for concurrent MDPs ⋮ Sequential Convex Programming for the Efficient Verification of Parametric MDPs ⋮ A dynamic inventory rationing problem with uncertain demand and production rates ⋮ A survey of decision making and optimization under uncertainty ⋮ Evidential Markov Decision Processes ⋮ Unnamed Item ⋮ Robust planning with incomplete domain models ⋮ Discrete time Markov chains with interval probabilities ⋮ Light robustness in the optimization of Markov decision processes with uncertain parameters ⋮ Decision making with imprecise probabilities and utilities by means of statistical preference and stochastic dominance ⋮ The optimal robust control policy for uncertain semi-Markov control processes ⋮ Fuzzy rationality and parameter elicitation in decision analysis ⋮ Machine learning models, epistemic set-valued data and generalized loss functions: an encompassing approach ⋮ Decision making under uncertainty using imprecise probabilities ⋮ Robust analysis of discounted Markov decision processes with uncertain transition probabilities ⋮ Deniable Functional Encryption ⋮ IMPRECISE MARKOV CHAINS AND THEIR LIMIT BEHAVIOR ⋮ Partially observable Markov decision processes with imprecise parameters ⋮ Patient-Type Bayes-Adaptive Treatment Plans ⋮ An active-set strategy to solve Markov decision processes with good-deal risk measure ⋮ Bounded-parameter Markov decision processes ⋮ Trading utility and uncertainty: applying the value of information to resolve the exploration-exploitation dilemma in reinforcement learning ⋮ Robust control of the multi-armed bandit problem ⋮ Stochastic dynamics simulation with generalized interval probability ⋮ Concurrent MDPs with Finite Markovian Policies ⋮ Generalizing Markov decision processes to imprecise probabilities