Infinite Horizon Optimization for Finite State Markov Chain

DOI10.1137/0325088MaRDI QIDQ3773809zbMATH OpenOpenAlexFDO

Authors Arie Leizarowitz

Publication date 1987

Published in SIAM Journal on Control and Optimization (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1137/0325088

zbMATH Keywords

long run averagefinite state Markov chainovertaking optimality criterioninfinite horizon controlstationary optimal strategy

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Existence of optimal solutions to problems involving randomness (49J55) Optimal stochastic control (93E20)

Recommendations

• scientific article; zbMATH DE number 4085565
• Publication:4735696
• Control of Markov Chains with Long-Run Average Cost Criterion: The Dynamic Programming Equations
• Overtaking and Almost-Sure Optimality for Infinite Horizon Markov Decision Processes
• scientific article; zbMATH DE number 1424150

Cited in

(8)

• On finite long run costs and rewards in infinite Markov chains
• Approximate Fixed Point Iteration with an Application to Infinite Horizon Markov Decision Processes
• scientific article; zbMATH DE number 3962918 (Why is no real title available?)
• scientific article; zbMATH DE number 4122710 (Why is no real title available?)
• Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria
• scientific article; zbMATH DE number 3965147 (Why is no real title available?)
• Infinite horizon optimality criteria for equipment replacement under technological change
• Overtaking Optimal Regulation and Tracking of Piecewise Diffusion Linear Systems

This page was built for publication: Infinite Horizon Optimization for Finite State Markov Chain

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3773809)