Discounted continuous-time constrained Markov decision processes in Polish spaces
From MaRDI portal
Publication:655591
DOI10.1214/10-AAP749zbMath1258.90104arXiv1201.0089MaRDI QIDQ655591
Publication date: 4 January 2012
Published in: The Annals of Applied Probability (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1201.0089
occupation measure; continuous-time Markov decision process; unbounded transition rates; linear programming formulation; constrained optimal policy
90C40: Markov and semi-Markov decision processes
60J27: Continuous-time Markov processes on discrete state spaces
Related Items
Unnamed Item, Risk-Sensitive Discounted Continuous-Time Markov Decision Processes with Unbounded Rates, Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates, Continuous-time zero-sum games for Markov chains with risk-sensitive finite-horizon cost criterion, Kolmogorov's Equations for Jump Markov Processes and Their Applications to Control Problems, Sufficiency of Markov Policies for Continuous-Time Jump Markov Decision Processes, Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates, On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes, Continuous-time zero-sum games for markov decision processes with discounted risk-sensitive cost criterion on a general state space, Zero-sum infinite-horizon discounted piecewise deterministic Markov games, A dynamic analytic method for risk-aware controlled martingale problems, Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach, A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes, Continuous-time Markov decision processes with state-dependent discount factors, A mean-variance optimization problem for discounted Markov decision processes, Constrained expected average stochastic games for continuous-time jump processes, Discounted stochastic games for continuous-time jump processes with an uncountable state space, Continuous-time zero-sum games for Markov decision processes with discounted risk-sensitive cost criterion, First passage risk probability minimization for piecewise deterministic Markov decision processes, Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces, Constrained continuous-time Markov decision processes on the finite horizon, Nonzero-sum risk-sensitive continuous-time stochastic games with ergodic costs, Asymptotic optimality and rates of convergence of quantized stationary policies in continuous-time Markov decision processes, Continuous-time Markov decision processes under the risk-sensitive first passage discounted cost criterion, Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces, Absorbing Continuous-Time Markov Decision Processes with Total Cost Criteria
Cites Work
- A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
- Average optimality for continuous-time Markov decision processes in Polish spaces
- Continuous-time Markov decision processes. Theory and applications
- Stochastic optimal control. The discrete time case
- Constrained Markov control processes in Borel spaces: the discounted case
- Continuous-time controlled Markov chains.
- Computable exponential convergence rates for stochastically ordered Markov processes
- Non-randomized policies for constrained Markov decision processes
- Constrained continuous-time Markov decision processes with average criteria
- Discounted Markov decision processes with utility constraints
- Constrained Discounted Markov Decision Processes and Hamiltonian Cycles
- Markov Decision Problems and State-Action Frequencies
- Constrained Discounted Markov Decision Chains
- Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
- Constrained admission control to a queueing system
- Управляемая скачкообразная модель с дисконтированием при наличии ограничений
- Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
- Controlled Markov Models with Countable State Space and Continuous Time
- Constrained Discounted Dynamic Programming
- Bias Optimality in Controlled Queueing Systems
- Constrained Average Cost Markov Control Processes in Borel Spaces
- Constrained dynamic programming with two discount factors: applications and an algorithm
- Constrained markov decision processes with compact state and action spaces: the average case
- A probabilistic analysis of bias optimality in unichain Markov decision processes
- Constrained Continuous-Time Markov Control Processes with Discounted Criteria
- Constrained Markov Decision Models with Weighted Discounted Rewards
- Robustness of Policies in Constrained Markov Decision Processes
- Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes
- Ergodic Control of Continuous-Time Markov Chains with Pathwise Constraints
- Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
- Continuously Discounted Markov Decision Model with Countable State and Action Space
- Lectures on Choquet's theorem
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item