Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach
From MaRDI portal
(Redirected from Publication:457293)
Abstract: This paper deals with unconstrained discounted continuous-time Markov decision processes in Borel state and action spaces. Under some conditions imposed on the primitives, allowing unbounded transition rates and unbounded (from both above and below) cost rates, we show the regularity of the controlled process, which ensures the underlying models to be well defined. Then we develop the dynamic programming approach by showing that the Bellman equation is satisfied (by the optimal value). Finally, under some compactness-continuity conditions, we obtain the existence of a deterministic stationary optimal policy out of the class of randomized history-dependent policies.
Recommendations
- Discounted continuous-time Markov decision processes with unbounded rates: the convex analytic approach
- Nonstationary continuous time Markov decision processes with discounted criterion
- Continuous-time Markov decision processes with state-dependent discount factors
- Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates
- Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
Cites work
- scientific article; zbMATH DE number 1325008 (Why is no real title available?)
- scientific article; zbMATH DE number 700091 (Why is no real title available?)
- scientific article; zbMATH DE number 977051 (Why is no real title available?)
- A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
- Absorbing continuous-time Markov decision processes with total cost criteria
- Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case
- Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach
- Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
- Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates
- Continuous-time Markov decision processes. Theory and applications
- Continuously Discounted Markov Decision Model with Countable State and Action Space
- Denumerable-state continuous-time Markov decision processes with unbounded transition and reward rates under the discounted criterion
- Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates
- Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach
- Discounted continuous-time Markov decision processes with unbounded rates: the convex analytic approach
- Discounted continuous-time constrained Markov decision processes in Polish spaces
- Linear programming and constrained average optimality for general continuous-time Markov decision processes in history-dependent policies
- Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
- Reduction of discounted continuous-time MDPs with unbounded jump and reward rates to discrete-time total-reward mdps
- Selected topics on continuous-time controlled Markov chains and Markov games
- Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
- Stochastic optimal control. The discrete time case
- The transformation method for continuous-time Markov decision processes
Cited in
(19)- Kolmogorov's equations for jump Markov processes and their applications to control problems
- Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates
- Time-varying Markov decision processes with state-action-dependent discount factors and unbounded costs
- On the link between infinite horizon control and quasi-stationary distributions
- Sufficiency of Markov policies for continuous-time jump Markov decision processes
- Finite horizon continuous-time Markov decision processes with mean and variance criteria
- Computable approximations for continuous-time Markov decision processes on Borel spaces based on empirical measures
- Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach
- scientific article; zbMATH DE number 1536220 (Why is no real title available?)
- First passage risk probability minimization for piecewise deterministic Markov decision processes
- The transformation method for continuous-time Markov decision processes
- Optimal strategies in a production inventory control model
- Finite horizon risk-sensitive continuous-time Markov decision processes with unbounded transition and cost rates
- On the nonexplosion and explosion for nonhomogeneous Markov pure jump processes
- Discounted continuous-time Markov decision processes with unbounded rates: the convex analytic approach
- Discounted stochastic games for continuous-time jump processes with an uncountable state space
- Computable approximations for average Markov decision processes in continuous time
- Discounted Continuous-Time Markov Decision Processes with Constraints: Unbounded Transition and Loss Rates
- Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations
This page was built for publication: Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q457293)
