Algorithms for optimization and stabilization of controlled Markov chains.

DOI10.1007/BF02823147zbMath1075.90558MaRDI QIDQ5955823

Sean P. Meyn

Publication date: 18 February 2002

Published in: Sādhanā (Search for Journal in Brave)

Mathematics Subject Classification ID

90B22: Queues and service in operations research

93E20: Optimal stochastic control

90C40: Markov and semi-Markov decision processes

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Markov chains and stochastic stability
• Value iteration and optimization of multiclass queueing networks
• Multiplicative ergodicity and large deviations for an irreducible Markov chain.
• On positive Harris recurrence of multiclass queueing networks: A unified approach via fluid limit models
• Exponential and uniform ergodicity of Markov processes
• Ergodicity of stochastic processes describing the operation of open queueing networks
• A Liapounov bound for solutions of the Poisson equation
• Dynamic instabilities and stabilization methods in distributed real-time scheduling of manufacturing systems
• General Irreducible Markov Chains and Non-Negative Operators
• Value Iteration in a Class of Communicating Markov Decision Chains with the Average Cost Criterion
• Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey
• Duality and linear programs for stability and performance analysis of queuing networks and scheduling policies