Markov decision processes
From MaRDI portal
The paper is an introduction to Markov decision processes mainly addressed to possible applicants. Therefore it presents a finite model only, but a broad variety of objectives, algorithms (e.g. aggregation), and extensions (e.g. semi-Markov, partially observed, adaptive multiobjective, and constrained models). Some remarks on possible future research are added.
Recommendations
- MARKOV DECISION PROCESSES
- scientific article; zbMATH DE number 4154239
- scientific article; zbMATH DE number 420890
- Markov decision processes
- Markov decision processes in practice
- Markov decision processes with their applications
- scientific article; zbMATH DE number 970511
- scientific article; zbMATH DE number 1931851
- scientific article; zbMATH DE number 3128787
- scientific article; zbMATH DE number 700091
Cites work
- A modified dynamic programming method for Markovian decision problems
- A Survey of Applications of Markov Decision Processes
- Action Elimination Procedures for Modified Policy Iteration Algorithms
- An Iterative Aggregation Procedure for Markov Decision Processes
- Approximations of Dynamic Programs, I
- Approximations of Dynamic Programs, II
- Bounds and Transformations for Discounted Finite Markov Decision Chains
- Contraction Mappings in the Theory Underlying Dynamic Programming
- Convergence of Dynamic Programming Models
- Discounted Dynamic Programming
- Dynamic programming, Markov chains, and the method of successive approximations
- Finite state Markovian decision processes
- scientific article; zbMATH DE number 4133249 (Why is no real title available?)
- scientific article; zbMATH DE number 3126094 (Why is no real title available?)
- scientific article; zbMATH DE number 3148886 (Why is no real title available?)
- scientific article; zbMATH DE number 3168214 (Why is no real title available?)
- scientific article; zbMATH DE number 3843492 (Why is no real title available?)
- scientific article; zbMATH DE number 3906232 (Why is no real title available?)
- scientific article; zbMATH DE number 3657463 (Why is no real title available?)
- scientific article; zbMATH DE number 3670172 (Why is no real title available?)
- scientific article; zbMATH DE number 3696861 (Why is no real title available?)
- scientific article; zbMATH DE number 3724212 (Why is no real title available?)
- scientific article; zbMATH DE number 3604231 (Why is no real title available?)
- scientific article; zbMATH DE number 1206370 (Why is no real title available?)
- scientific article; zbMATH DE number 3793773 (Why is no real title available?)
- scientific article; zbMATH DE number 3263788 (Why is no real title available?)
- scientific article; zbMATH DE number 3277112 (Why is no real title available?)
- scientific article; zbMATH DE number 3322720 (Why is no real title available?)
- scientific article; zbMATH DE number 3338194 (Why is no real title available?)
- scientific article; zbMATH DE number 3361677 (Why is no real title available?)
- Infinite horizon Markov decision processes with unknown or variable discount factors
- Iterative Aggregation-Disaggregation Procedures for Discounted Semi-Markov Reward Processes
- Letter to the Editor—A Test for Suboptimal Actions in Markovian Decision Problems
- Markov Decision Processes with Imprecise Transition Probabilities
- Mean, variance and probabilistic criteria in finite Markov decision processes: A review
- Minimizing a Submodular Function on a Lattice
- Modified Policy Iteration Algorithms for Discounted Markov Decision Problems
- Multi-objective infinite-horizon discounted Markov decision processes
- On Finding the Maximal Gain for Markov Decision Processes
- On the Optimality of Myopic Policies in Sequential Decision Problems
- Optimality and efficiency. I
- Parameter Imprecision in Finite State, Finite Action Dynamic Programs
- Performance evaluation and perturbation analysis of discrete event dynamic systems
- Reward revision and the average reward Markov decision process
- Reward Revision for Discounted Markov Decision Problems
- Sequential Decision Problems with Expected Utility Criteria. III: Upper and Lower Transience
- Some Bounds for Discounted Sequential Decision Processes
- State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms
- Stochastic optimal control. The discrete time case
- Suboptimal Design for Large Scale, Multimodule Systems
- Suboptimal policy determination for large-scale Markov decision processes. I: Description and bounds
- Suboptimal policy determination for large-scale Markov decision processes. II: Implementation and numerical evaluation
- Sufficient statistics in the optimum control of stochastic systems
- The Asymptotic Behavior of Undiscounted Value Iteration in Markov Decision Problems
- Vector-Valued Dynamic Programming
Cited in
(42)- Optimal recovery strategies for manufacturing systems
- Optimal cost and policy for a Markovian replacement problem
- Sequential process control under capacity constraints.
- Multiaction maintenance subject to action-dependent risk and stochastic failure
- Bounded-parameter Markov decision processes
- Intelligent agent supporting human-multi-robot team collaboration
- Computation of weighted sums of rewards for concurrent MDPs
- Relevant states and memory in Markov chain bootstrapping and simulation
- Determining the optimal strategies for discrete control problems on stochastic networks with discounted costs
- A multi-period TSP with stochastic regular and urgent demands
- On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes
- Competing Markov decision processes
- An axiomatic approach to Markov decision processes
- scientific article; zbMATH DE number 4133249 (Why is no real title available?)
- Markov decision processes in the modelling of rational agents
- A Markovian process modeling for Pickomino
- Preliminary study on Markov decision-making vector processes
- scientific article; zbMATH DE number 3854800 (Why is no real title available?)
- A theoretical model of measure-valued Markov processes simulating the divergent thinking of man
- scientific article; zbMATH DE number 4154239 (Why is no real title available?)
- Markov decision processes in artificial intelligence. Vol. 1. General principles and applications
- MARKOV DECISION PROCESSES
- scientific article; zbMATH DE number 3906263 (Why is no real title available?)
- scientific article; zbMATH DE number 45269 (Why is no real title available?)
- scientific article; zbMATH DE number 177825 (Why is no real title available?)
- A Survey of Applications of Markov Decision Processes
- Markov Decision Processes with Imprecise Transition Probabilities
- Continuous time shock markov decision processes with discounted criterion
- scientific article; zbMATH DE number 1134975 (Why is no real title available?)
- scientific article; zbMATH DE number 1786113 (Why is no real title available?)
- scientific article; zbMATH DE number 7014212 (Why is no real title available?)
- Was Angelina Jolie right? Optimizing cancer prevention strategies among BRCA mutation carriers
- The value of observing the condition of a deteriorating machine
- Quantile Markov Decision Processes
- Robust Markov Decision Processes
- Multitime scale markov decision processes
- An Heuristic for Multi-Dimensional Markov Decision Processes
- Multi-Actor Markov Decision Processes
- Solving Markov decision processes by \(d\)-graph algorithms
- Markov decision processes
- Approximate solutions to constrained risk-sensitive Markov decision processes
- A survey of solution techniques for the partially observed Markov decision process
This page was built for publication: Markov decision processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5904001)
