Note on discounted continuous-time Markov decision processes with a lower bounding function
From MaRDI portal
Abstract: In this paper, we consider the discounted continuous-time Markov decision process (CTMDP) with a lower bounding function. In this model, the negative part of each cost rate is bounded by the drift function, say , whereas the positive part is allowed to be arbitrarily unbounded. Our focus is on the existence of a stationary optimal policy for the discounted CTMDP problems out of the more general class. Both constrained and unconstrained problems are considered. Our investigations are based on a useful transformation for nonhomogeneous Markov pure jump processes that has not yet been widely applied to the study of CTMDPs. This technique was not employed in previous literature, but it clarifies the roles of the imposed conditions in a rather transparent way. As a consequence, we withdraw and weaken several conditions commonly imposed in the literature.
Recommendations
- scientific article; zbMATH DE number 1829768
- Discounted continuous-time Markov decision processes with unbounded rates: the convex analytic approach
- scientific article; zbMATH DE number 1159486
- Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates
- scientific article; zbMATH DE number 1536370
Cites work
- A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes
- Conditions for the solvability of the linear programming formulation for constrained discounted Markov decision processes
- Constrained total undiscounted continuous-time Markov decision processes
- Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach
- Continuous-time Markov chains. An applications-oriented approach
- Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
- Continuous-time Markov decision processes. Theory and applications
- Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations
- Countable state Markov processes: non-explosiveness and moment function
- Discounted continuous-time Markov decision processes with unbounded rates: the convex analytic approach
- Discounted dynamic programming with unbounded returns: application to economic models
- Discrete Dynamic Programming with Sensitive Discount Optimality Criteria
- Error bounds for rolling horizon policies in discrete-time Markov control processes
- Finite state continuous time Markov decision processes with an infinite planning horizon
- scientific article; zbMATH DE number 3664132 (Why is no real title available?)
- scientific article; zbMATH DE number 3724212 (Why is no real title available?)
- scientific article; zbMATH DE number 3478187 (Why is no real title available?)
- scientific article; zbMATH DE number 1348599 (Why is no real title available?)
- scientific article; zbMATH DE number 977051 (Why is no real title available?)
- scientific article; zbMATH DE number 1119444 (Why is no real title available?)
- scientific article; zbMATH DE number 949661 (Why is no real title available?)
- Kolmogorov forward equation and explosiveness in countable state Markov processes
- Markov decision processes with applications to finance.
- Markov Decision Processes with Finite State and Decision Spaces
- Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
- Nonhomogeneous Markov processes
- On solutions of Kolmogorov's equations for nonhomogeneous jump Markov processes
- Optimal growth models with bounded or unbounded returns: A unifying approach
- Practical criterion for uniqueness of \(Q\)-processes
- Randomized and relaxed strategies in continuous-time Markov decision processes
- Reduction of discounted continuous-time MDPs with unbounded jump and reward rates to discrete-time total-reward mdps
- Selected topics on continuous-time controlled Markov chains and Markov games
- Splitting randomized stationary policies in total-reward Markov decision processes
- Stochastic games with unbounded payoffs: applications to robust control in economics
- The expected total cost criterion for Markov decision processes under constraints
- The expected total cost criterion for Markov decision processes under constraints: a convex analytic approach
- Uniqueness criteria for continuous-time Markov chains with general transition structures
This page was built for publication: Note on discounted continuous-time Markov decision processes with a lower bounding function
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4684909)
