A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
From MaRDI portal
(Redirected from Publication:997928)
Recommendations
- Continuous-time Markov decision processes. Theory and applications
- Continuous-time markov decision processes with nonzero terminal reward
- A Survey of Applications of Markov Decision Processes
- A survey on semi-Markov decision processes
- Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates
- Continuous-time Markov decision processes with \(n\)th-bias optimality criteria
- scientific article; zbMATH DE number 4081328
- Continuous time markov decision processes with nonuniformly bounded transition rate: expected total rewards
Cites work
- scientific article; zbMATH DE number 5836214 (Why is no real title available?)
- scientific article; zbMATH DE number 3122709 (Why is no real title available?)
- scientific article; zbMATH DE number 3126094 (Why is no real title available?)
- scientific article; zbMATH DE number 3148886 (Why is no real title available?)
- scientific article; zbMATH DE number 3678487 (Why is no real title available?)
- scientific article; zbMATH DE number 3523369 (Why is no real title available?)
- scientific article; zbMATH DE number 3573013 (Why is no real title available?)
- scientific article; zbMATH DE number 1233798 (Why is no real title available?)
- scientific article; zbMATH DE number 1325008 (Why is no real title available?)
- scientific article; zbMATH DE number 1159486 (Why is no real title available?)
- scientific article; zbMATH DE number 3438176 (Why is no real title available?)
- scientific article; zbMATH DE number 1751447 (Why is no real title available?)
- scientific article; zbMATH DE number 1786120 (Why is no real title available?)
- scientific article; zbMATH DE number 837313 (Why is no real title available?)
- scientific article; zbMATH DE number 921048 (Why is no real title available?)
- scientific article; zbMATH DE number 3239038 (Why is no real title available?)
- scientific article; zbMATH DE number 3338194 (Why is no real title available?)
- scientific article; zbMATH DE number 3414123 (Why is no real title available?)
- scientific article; zbMATH DE number 3186512 (Why is no real title available?)
- A birth–death model of advertising and pricing
- A note on bias optimality in controlled queueing systems
- A note on optimality conditions for continuous-time Markov decision processes with average cost criterion
- A probabilistic analysis of bias optimality in unichain Markov decision processes
- Applying a New Device in the Optimization of Exponential Queuing Systems
- Average optimality for continuous-time Markov decision processes in Polish spaces
- Average, Sensitive and Blackwell Optimal Policies in Denumerable Markov Decision Chains with Unbounded Rewards
- BIAS OPTIMALITY IN A QUEUE WITH ADMISSION CONTROL
- Basic ideas for event-based optimization of Markov systems
- Bias Optimality for Continuous-Time Controlled Markov Chains
- Bias Optimality in Controlled Queueing Systems
- Bias and overtaking equilibria for zero-sum continuous-time Markov games
- Bias optimal admission control policies for a multiclass nonstationary queueing system
- Bias optimality versus strong 0-discount optimality in Markov control processes with unbounded costs
- Blackwell Optimality in Borelian Continuous-in-Action Markov Decision Processes
- Blackwell optimal policies in a Markov decision process with a Borel state space
- Blackwell optimality in the class of Markov policies for continuous-time controlled Markov chains
- Blackwell optimality in the class of all policies in Markov decision chains with a Borel state space and unbounded rewards
- Blackwell optimality in the class of stationary policies in Markov decision chains with a Borel state space and unbounded rewards
- Computable exponential convergence rates for stochastically ordered Markov processes
- Conditions for existence of average and Blackwell optimal stationary policies in denumerable Markov decision processes
- Continuous time Markov decision processes with discounted moment criterion
- Continuous time Markovian decision processes average return criterion
- Continuous time control of Markov processes on an arbitrary state space: Discounted rewards
- Continuous-time Markov chains. An applications-oriented approach
- Continuous-time controlled Markov chains with discounted rewards
- Continuous-time controlled Markov chains.
- Continuously Discounted Markov Decision Model with Countable State and Action Space
- Controlled Markov Models with Countable State Space and Continuous Time
- Decision and control in uncertain resource systems
- Denumerable-state continuous-time Markov decision processes with unbounded transition and reward rates under the discounted criterion
- Discounted and average Markov decision processes with unbounded rewards: New conditions
- Discrete Dynamic Programming
- Discrete Dynamic Programming with Sensitive Discount Optimality Criteria
- Discrete Dynamic Programming with a Small Interest Rate
- Drift and monotonicity conditions for continuous-time controlled markov chains with an average criterion
- Dynamic programming and optimal control. Vol. 2.
- Ergodic Control of Continuous-Time Markov Chains with Pathwise Constraints
- Finite state continuous time Markov decision processes with an infinite planning horizon
- Handbook of Markov decision processes. Methods and applications
- Markov Decision Processes with Finite State and Decision Spaces
- Mathematical models for the control of pests and infectious diseases: A survey
- Multicriteria impulsive control of jump Markov processes
- Nondiscounted Continuous Time Markovian Decision Process with Countable State Space
- Nonstationary continuous-time Markov control processes with discounted costs on infinite horizon
- Nonzero-sum games for continuous-time Markov chains with unbounded discounted payoffs
- On Finding Optimal Policies in Discrete Dynamic Programming with No Discounting
- On Homogeneous Markov Models with Continuous Time and Finite or Countable State Space
- On Recurrent Denumerable Decision Processes
- On a Class of Strategies in General Markov Decision Models
- On maximal rewards and \(\varepsilon\)-optimal policies in continuous time Markov decision chains
- On the Equivalence of Two Expected Average Cost Criteria for Semi-Markov Control Processes
- On the Integro-Differential Equations of Purely Discontinuous Markoff Processes
- On the Second Optimality Equation for Semi-Markov Decision Models
- Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards
- Optimal Control of a Birth and Death Epidemic Process
- Optimal control of the simple stochastic epidemic with variable recovery rates
- Optimal design and control of queues
- Overtaking and Almost-Sure Optimality for Infinite Horizon Markov Decision Processes
- Recurrence Conditions for Average and Blackwell Optimality in Denumerable State Markov Decision Chains
- Relation between continuous and discrete time markovian decision problems
- Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
- Sensitive discount optimality in controlled one-dimensional diffusions
- Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
- Technical Note—An Equivalence Between Continuous and Discrete Time Markov Decision Processes
- The Laurent series, sensitive discount and Blackwell optimality for continuous-time controlled Markov chains
- The scalarization approach to multiobjective Markov control problems: \textit{Why} does it work?
- Variance minimization and the overtaking optimality approach to continuous-time controlled Markov chains
- Zero-sum continuous-time Markov games with unbounded transition and discounted payoff rates
- Zero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates
Cited in
(35)- On the vanishing discount factor approach for Markov decision processes with weakly continuous transition probabilities
- Total reward criteria for unconstrained/constrained continuous-time Markov decision processes
- Controlled diffusion processes with Markovian switchings for modeling dynamical engineering systems
- Risk-sensitive control of continuous time Markov chains
- The vanishing discount approach to constrained continuous-time controlled Markov chains
- Hamilton-Jacobi-Bellman inequality for the average control of piecewise deterministic Markov processes
- Delayed Nondeterminism in Continuous-Time Markov Decision Processes
- The transformation method for continuous-time Markov decision processes
- Optimal switching on and off the entire service capacity of a parallel queue
- Discounted continuous-time constrained Markov decision processes in Polish spaces
- Bias optimality for multichain continuous-time Markov decision processes
- Continuous-time zero-sum stochastic game with stopping and control
- Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations
- Countable state Markov processes: non-explosiveness and moment function
- Impulsive Control for Continuous-Time Markov Decision Processes
- Accuracy of fluid approximations to controlled birth-and-death processes: absorbing case
- Continuous-time Markov decision processes with \(n\)th-bias optimality criteria
- Realizable strategies in continuous-time Markov decision processes
- New discount and average optimality conditions for continuous-time Markov decision processes
- Bias and Overtaking Optimality for Continuous-Time Jump Markov Decision Processes in Polish Spaces
- Impulsive control for continuous-time Markov decision processes: a linear programming approach
- A mean-variance optimization problem for discounted Markov decision processes
- Average sample-path optimality for continuous-time Markov decision processes in Polish spaces
- Optimal control of piecewise deterministic Markov processes
- Dynamic control of a single-server system with abandonments
- Finite-horizon optimality for continuous-time Markov decision processes with unbounded transition rates
- A survey on semi-Markov decision processes
- Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach
- Efficient approximation of optimal control for continuous-time Markov games
- scientific article; zbMATH DE number 3873074 (Why is no real title available?)
- Uniform ergodicity of continuous-time controlled Markov chains: a survey and new results
- Optimal control of Markov processes with age-dependent transition rates
- Average optimality for continuous-time Markov decision processes under weak continuity conditions
- Variance minimization and the overtaking optimality approach to continuous-time controlled Markov chains
- Strong \(n\)-discount and finite-horizon optimality for continuous-time Markov decision processes
This page was built for publication: A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q997928)
