Ergodic Control of Markov Chains with Constraints—the General Case

DOI10.1137/S1052623491218895MaRDI QIDQ4286624zbMATH OpenOpenAlexFDO

Authors Vivek Borkar

Publication date 27 March 1994

Published in SIAM Journal on Control and Optimization (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1137/s1052623491218895

zbMATH Keywords

Markov chainergodic control

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Optimal stochastic control (93E20)

Recommendations

• scientific article; zbMATH DE number 4085565
• Towards the optimal control of Markov chains with constraints
• Control of Markov Chains with Long-Run Average Cost Criterion: The Dynamic Programming Equations
• Constrained Discounted Markov Decision Chains
• Controlled diffusions with constraints. II

Cited in

(24)

• Action time sharing policies for ergodic control of Markov chains
• scientific article; zbMATH DE number 5957388 (Why is no real title available?)
• Performance analysis and controller synthesis for nonlinear systems with stochastic uncertainty constraints
• Postponing collapse: ergodic control with a probabilistic constraint
• Constrained markov decision processes with compact state and action spaces: the average case
• Control of a Markov process in a problem with constraints
• On Stochastic Evolution Equations with Stochastic Boundary Conditions
• Control of Markov Chains with Long-Run Average Cost Criterion: The Dynamic Programming Equations
• The LP approach in average reward MDPs with multiple cost constraints: The countable state case
• A note on the existence of optimal stationary policies for average Markov decision processes with countable states
• Optimality of mixed policies for average continuous-time Markov decision processes with constraints
• Constrained Markov decision processes in Borel spaces: from discounted to average optimality
• Towards the optimal control of Markov chains with constraints
• Average Reward Markov Decision Processes with Multiple Cost Constraints
• On Minimum Cost Per Unit Time Control of Markov Chains
• scientific article; zbMATH DE number 4170816 (Why is no real title available?)
• Optimal policies for constrained average-cost Markov decision processes
• Control of continuous-time Markov chains with safety constraints
• Optimal Distributed Uplink Channel Allocation: A Constrained MDP Formulation
• Markov control processes with pathwise constraints
• scientific article; zbMATH DE number 4203409 (Why is no real title available?)
• Multiple objective nonatomic Markov decision processes with total reward criteria
• Constrained discounted Markov decision processes with Borel state spaces
• On linear programming for constrained and unconstrained average-cost Markov decision processes with countable action spaces and strictly unbounded costs

This page was built for publication: Ergodic Control of Markov Chains with Constraints—the General Case

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4286624)