Discounted continuous-time constrained Markov decision processes in Polish spaces

DOI10.1214/10-AAP749zbMath1258.90104arXiv1201.0089MaRDI QIDQ655591

Xianping Guo, Xin-Yuan Song

Publication date: 4 January 2012

Published in: The Annals of Applied Probability (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1201.0089

zbMATH Keywords

occupation measurecontinuous-time Markov decision processunbounded transition rateslinear programming formulationconstrained optimal policy

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Continuous-time Markov processes on discrete state spaces (60J27)

Related Items (26)

Continuous-time zero-sum games for markov decision processes with discounted risk-sensitive cost criterion on a general state space ⋮ Kolmogorov's Equations for Jump Markov Processes and Their Applications to Control Problems ⋮ Discounted stochastic games for continuous-time jump processes with an uncountable state space ⋮ Continuous-time zero-sum games for Markov decision processes with discounted risk-sensitive cost criterion ⋮ First passage risk probability minimization for piecewise deterministic Markov decision processes ⋮ Constrained continuous-time Markov decision processes on the finite horizon ⋮ Sufficiency of Markov Policies for Continuous-Time Jump Markov Decision Processes ⋮ Finite-horizon piecewise deterministic Markov decision processes with unbounded transition rates ⋮ Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces ⋮ A mean-variance optimization problem for discounted Markov decision processes ⋮ Nonzero-sum risk-sensitive continuous-time stochastic games with ergodic costs ⋮ Zero-sum infinite-horizon discounted piecewise deterministic Markov games ⋮ Asymptotic optimality and rates of convergence of quantized stationary policies in continuous-time Markov decision processes ⋮ A dynamic analytic method for risk-aware controlled martingale problems ⋮ Continuous-time Markov decision processes under the risk-sensitive first passage discounted cost criterion ⋮ Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach ⋮ A linear programming formulation for constrained discounted continuous control for piecewise deterministic Markov processes ⋮ Continuous-time Markov decision processes with state-dependent discount factors ⋮ Unnamed Item ⋮ Constrained expected average stochastic games for continuous-time jump processes ⋮ Constrained semi-Markov decision processes with ratio and time expected average criteria in Polish spaces ⋮ Risk-Sensitive Discounted Continuous-Time Markov Decision Processes with Unbounded Rates ⋮ Absorbing Continuous-Time Markov Decision Processes with Total Cost Criteria ⋮ Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates ⋮ On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes ⋮ Continuous-time zero-sum games for Markov chains with risk-sensitive finite-horizon cost criterion

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
• Average optimality for continuous-time Markov decision processes in Polish spaces
• Continuous-time Markov decision processes. Theory and applications
• Stochastic optimal control. The discrete time case
• Constrained Markov control processes in Borel spaces: the discounted case
• Continuous-time controlled Markov chains.
• Computable exponential convergence rates for stochastically ordered Markov processes
• Non-randomized policies for constrained Markov decision processes
• Constrained continuous-time Markov decision processes with average criteria
• Discounted Markov decision processes with utility constraints
• Constrained Discounted Markov Decision Processes and Hamiltonian Cycles
• Markov Decision Problems and State-Action Frequencies
• Constrained Discounted Markov Decision Chains
• Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
• Constrained admission control to a queueing system
• Управляемая скачкообразная модель с дисконтированием при наличии ограничений
• Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
• Controlled Markov Models with Countable State Space and Continuous Time
• Constrained Discounted Dynamic Programming
• Bias Optimality in Controlled Queueing Systems
• Constrained Average Cost Markov Control Processes in Borel Spaces
• Constrained dynamic programming with two discount factors: applications and an algorithm
• Constrained markov decision processes with compact state and action spaces: the average case
• A probabilistic analysis of bias optimality in unichain Markov decision processes
• Constrained Continuous-Time Markov Control Processes with Discounted Criteria
• Constrained Markov Decision Models with Weighted Discounted Rewards
• Robustness of Policies in Constrained Markov Decision Processes
• Constrained Optimization for Average Cost Continuous-Time Markov Decision Processes
• Ergodic Control of Continuous-Time Markov Chains with Pathwise Constraints
• Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
• Continuously Discounted Markov Decision Model with Countable State and Action Space
• Lectures on Choquet's theorem

This page was built for publication: Discounted continuous-time constrained Markov decision processes in Polish spaces