Sample-path average optimality for Markov control processes

DOI10.1109/9.793787MaRDI QIDQ4506921zbMATH OpenOpenAlexFDO

Authors Jean B. Lasserre

Publication date 17 October 2000

Published in IEEE Transactions on Automatic Control (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1109/9.793787

zbMATH Keywords

Markov control processsample-path average cost criterion

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Optimal stochastic control (93E20)

Recommendations

• Sample-Path Optimality and Variance-Minimization of Average Cost Markov Control Processes
• scientific article; zbMATH DE number 851955
• Sample path optimality for a Markov optimization problem
• Sample path average optimality of Markov control processes with strictly unbounded cost
• Weak conditions for average optimality in Markov control processes

Cited in

(15)

• Convex analytic method revisited: further optimality results and performance of deterministic policies in average cost stochastic control
• Sample path optimality for a Markov optimization problem
• Another set of conditions for Markov decision processes with average sample-path costs
• STRONG AVERAGE OPTIMALITY FOR CONTROLLED NONHOMOGENEOUS MARKOV CHAINS^*
• Sample-Path Optimal Stationary Policies in Stable Markov Decision Chains with the Average Reward Criterion
• Growth Optimal Investment with Transaction Costs
• Average control of Markov decision processes with Feller transition probabilities and general action spaces
• Sample path average optimality of Markov control processes with strictly unbounded cost
• Sample-path average cost optimality for semi-Markov control processes on Borel spaces: unbounded costs and mean holding times
• Sample-path optimality in average Markov decision chains under a double Lyapunov function condition
• Denumerable controlled Markov chains with average reward criterion: Sample path optimality
• A counterexample on sample-path optimality in stable Markov decision chains with the average reward criterion
• Sample-Path Optimality and Variance-Minimization of Average Cost Markov Control Processes
• On linear programming for constrained and unconstrained average-cost Markov decision processes with countable action spaces and strictly unbounded costs
• On the Minimum Pair Approach for Average Cost Markov Decision Processes with Countable Discrete Action Spaces and Strictly Unbounded Costs

This page was built for publication: Sample-path average optimality for Markov control processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4506921)