Discounted continuous-time constrained Markov decision processes in Polish spaces
From MaRDI portal
Publication:655591
DOI10.1214/10-AAP749zbMath1258.90104arXiv1201.0089MaRDI QIDQ655591
Publication date: 4 January 2012
Published in: The Annals of Applied Probability (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1201.0089
occupation measure; continuous-time Markov decision process; unbounded transition rates; linear programming formulation; constrained optimal policy
90C40: Markov and semi-Markov decision processes
60J27: Continuous-time Markov processes on discrete state spaces
Related Items
On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes, Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach, A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes, Continuous-time Markov decision processes with state-dependent discount factors, A mean-variance optimization problem for discounted Markov decision processes, Constrained continuous-time Markov decision processes on the finite horizon, Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces, Absorbing Continuous-Time Markov Decision Processes with Total Cost Criteria
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
- Average optimality for continuous-time Markov decision processes in Polish spaces
- Continuous-time Markov decision processes. Theory and applications
- Stochastic optimal control. The discrete time case
- Constrained Markov control processes in Borel spaces: the discounted case
- Continuous-time controlled Markov chains.
- Computable exponential convergence rates for stochastically ordered Markov processes
- Non-randomized policies for constrained Markov decision processes
- Constrained continuous-time Markov decision processes with average criteria
- Discounted Markov decision processes with utility constraints
- Constrained Discounted Markov Decision Processes and Hamiltonian Cycles
- Markov Decision Problems and State-Action Frequencies
- Constrained Discounted Markov Decision Chains
- Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
- Constrained admission control to a queueing system
- Управляемая скачкообразная модель с дисконтированием при наличии ограничений
- Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
- Controlled Markov Models with Countable State Space and Continuous Time
- Constrained Discounted Dynamic Programming
- Bias Optimality in Controlled Queueing Systems
- Constrained Average Cost Markov Control Processes in Borel Spaces
- Constrained dynamic programming with two discount factors: applications and an algorithm
- Constrained markov decision processes with compact state and action spaces: the average case
- A probabilistic analysis of bias optimality in unichain Markov decision processes
- Constrained Continuous-Time Markov Control Processes with Discounted Criteria
- Constrained Markov Decision Models with Weighted Discounted Rewards
- Robustness of Policies in Constrained Markov Decision Processes
- Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes
- Ergodic Control of Continuous-Time Markov Chains with Pathwise Constraints
- Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
- Continuously Discounted Markov Decision Model with Countable State and Action Space
- Lectures on Choquet's theorem
