Equivalence of Lyapunov stability criteria in a class of Markov decision processes

DOI10.1007/BF01189027zbMath0766.90082OpenAlexW2028955531MaRDI QIDQ1194209

Rolando Cavazos-Cadena, Onésimo Hernández-Lerma

Publication date: 27 September 1992

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/bf01189027

zbMATH Keywords

countable state spacediscrete time average reward Markov decision processesLyapunov stability criteria

Mathematics Subject Classification ID

Lyapunov and other classical stabilities (Lagrange, Poisson, (L^p, l^p), etc.) in control theory (93D05) Markov and semi-Markov decision processes (90C40)

Related Items

Approximation of average cost optimal policies for general Markov decision processes with unbounded costs, Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria, A pause control approach to the value iteration scheme in average Markov decision processes, Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion, Discrete-time zero-sum games for Markov chains with risk-sensitive average cost criterion, Antisideslip and antirollover safety speed controller design for vehicle on curved road, A note on the vanishing interest rate approach in average Markov decision chains with continuous and bounded costs, Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: the fixed-point approach revisited, Denumerable controlled Markov chains with average reward criterion: Sample path optimality, Continuity of the optimal average cost in Markov decision chains with small risk-sensitivity

Cites Work

• Existence of optimal stationary policies in average reward Markov decision processes with a recurrent state
• Adaptive Markov control processes
• The average-optimal adaptive control of a Markov renewal model in presence of an unknown parameter
• On the Stochastic Matrices Associated with Certain Queuing Processes
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item