Strong average optimality criterion for continuous-time Markov decision processes

zbMATH Open1307.93467MaRDI QIDQ5179071FDOQ5179071

Authors: Qingda Wei, Xian Chen 

Publication date: 19 March 2015

Full work available at URL: http://www.kybernetika.cz/content/2014/6/950

Recommendations

• Average optimality for continuous-time Markov decision processes under weak continuity conditions
• New sufficient conditions for average optimality in continuous-time Markov decision processes
• Average optimality for continuous-time Markov decision processes in Polish spaces
• A note on optimality conditions for continuous-time Markov decision processes with average cost criterion
• Average optimality for continuous-time Markov decision processes with a policy iteration approach

zbMATH Keywords

unbounded transition ratesoptimal policycontinuous-time Markov decision processesoptimal value functionfinite-horizon expected total cost criterionstrong average optimality criterion

Mathematics Subject Classification ID

Optimality conditions for problems involving randomness (49K45) Markov and semi-Markov decision processes (90C40) Optimal stochastic control (93E20)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Continuous-time Markov decision processes. Theory and applications
• On optimality criteria for dynamic programs with long finite horizons
• Finite State Continuous Time Markov Decision Processes with a Finite Planning Horizon
• Computable bounds for geometric convergence rates of Markov chains
• New discount and average optimality conditions for continuous-time Markov decision processes
• Markov decision processes with applications to finance.
• Title not available (Why is that?)
• Title not available (Why is that?)
• Average optimality for continuous-time Markov decision processes in Polish spaces
• Controlled Jump Markov Models
• Average optimality for continuous-time Markov decision processes with a policy iteration approach
• New sufficient conditions for average optimality in continuous-time Markov decision processes
• Continuous-Time Markov Decision Processes with Discounted Rewards: The Case of Polish Spaces
• Controlled jump processes
• On the finite horizon Bellman equation for controlled Markov jump models with unbounded characteristics: Existence and approximation
• On the Integro-Differential Equations of Purely Discontinuous Markoff Processes
• Average optimality inequality for continuous-time Markov decision processes in Polish spaces
• On strong average optimality of Markov decision processes with unbounded costs
• Continuous-Time Controlled Jump Markov Processes on the Finite Horizon
• Title not available (Why is that?)
• Title not available (Why is that?)

Cited In (23)

• Nonzero-sum risk-sensitive finite-horizon continuous-time stochastic games
• Discount-sensitive equilibria in zero-sum stochastic differential games
• Constrained expected average stochastic games for continuous-time jump processes
• Average optimality for continuous-time Markov decision processes under weak continuity conditions
• Optimal average value convergence in nonhomogeneous Markov decision processes
• Nonzero-sum games for continuous-time jump processes under the expected average payoff criterion
• A new strong optimality criterion for nonstationary Markov decision processes
• STRONG AVERAGE OPTIMALITY FOR CONTROLLED NONHOMOGENEOUS MARKOV CHAINS^*
• New sufficient conditions for average optimality in continuous-time Markov decision processes
• Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards
• Exponential Convergence in Undiscounted Continuous-Time Markov Decision Chains
• A note on optimality conditions for continuous-time Markov decision processes with average cost criterion
• Uniform ergodicity of continuous-time controlled Markov chains: a survey and new results
• Average optimality for continuous-time Markov decision processes with a policy iteration approach
• Continuous-time Markov decision processes under the risk-sensitive average cost criterion
• Mean-semivariance optimality for continuous-time Markov decision processes
• Average cost criterion induced by the regular utility function for continuous-time Markov decision processes
• Title not available (Why is that?)
• Title not available (Why is that?)
• Continuous-time Markov decision processes with risk-sensitive finite-horizon cost criterion
• Risk-sensitive average continuous-time Markov decision processes with unbounded rates
• Strong \(n\)-discount and finite-horizon optimality for continuous-time Markov decision processes
• Finite approximation for finite-horizon continuous-time Markov decision processes

This page was built for publication: Strong average optimality criterion for continuous-time Markov decision processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5179071)