scientific article; zbMATH DE number 1424150

MaRDI QIDQ4945343zbMATH OpenFDO

Authors Shaler jun. Stidham

Publication date 2000

zbMATH Keywords

algorithmsaverage-cost criteriaBellman optimality equationcomputational Markov chainsoptimal control of queuessemi-Markovian decision processestransition probabilities

Mathematics Subject Classification ID

Existence of optimal solutions to problems involving randomness (49J55) Computational methods in Markov chains (60J22) Transition functions, generators and resolvents (60J35) Numerical analysis or methods applied to Markov chains (65C40) Decision theory (91B06)

Recommendations

• scientific article; zbMATH DE number 4085565
• Control of Markov Chains with Long-Run Average Cost Criterion: The Dynamic Programming Equations
• On Minimum Cost Per Unit Time Control of Markov Chains
• Publication:4735696
• Constrained Discounted Markov Decision Chains

Cited in

(55)

• A simple technique in Markovian control with applications to resource allocation to resource allocation in communication networks
• Optimal control in light traffic Markov decision processes
• Markov-Dubins path via optimal control theory
• Optimal control of the two-state Markov process in discrete time
• Numerical methods of successive elimination and optimization in stochastic optimal control
• Controlled Markov absorption processes
• Optimal control of Markov processes with age-dependent transition rates
• Decentralized optimal control of Markov chains with a common past information set
• A strongly polynomial algorithm for controlled queues
• Generation of stationary control policies with best expected performance for a family of Markov chains
• Controlled random sequences and Markov chains
• scientific article; zbMATH DE number 3860883 (Why is no real title available?)
• Optimality of Piecewise-Constant Policies in Semi-Markov Decision Chains
• On decomposition in problem of Markov chain optimal control calculation by means of linear programming
• Constrained Discounted Markov Decision Chains
• scientific article; zbMATH DE number 4170816 (Why is no real title available?)
• scientific article; zbMATH DE number 5290174 (Why is no real title available?)
• On Minimum Cost Per Unit Time Control of Markov Chains
• scientific article; zbMATH DE number 3932752 (Why is no real title available?)
• scientific article; zbMATH DE number 3941292 (Why is no real title available?)
• scientific article; zbMATH DE number 3950347 (Why is no real title available?)
• scientific article; zbMATH DE number 3965147 (Why is no real title available?)
• Time-average optimal constrained semi-Markov decision processes
• scientific article; zbMATH DE number 4004053 (Why is no real title available?)
• Infinite Horizon Optimization for Finite State Markov Chain
• scientific article; zbMATH DE number 4085565 (Why is no real title available?)
• Control of Markov Chains with Long-Run Average Cost Criterion: The Dynamic Programming Equations
• scientific article; zbMATH DE number 4112415 (Why is no real title available?)
• scientific article; zbMATH DE number 17494 (Why is no real title available?)
• scientific article; zbMATH DE number 33511 (Why is no real title available?)
• New exactly solvable examples for controlled discrete-time Markov chains
• scientific article; zbMATH DE number 1254183 (Why is no real title available?)
• scientific article; zbMATH DE number 686687 (Why is no real title available?)
• The Computation of Average Optimal Policies in Denumerable State Markov Decision Chains
• scientific article; zbMATH DE number 1944271 (Why is no real title available?)
• Stochastic Dynamic Programming and Control of Markov Processes
• scientific article; zbMATH DE number 4121152 (Why is no real title available?)
• scientific article; zbMATH DE number 4122710 (Why is no real title available?)
• scientific article; zbMATH DE number 4122972 (Why is no real title available?)
• scientific article; zbMATH DE number 794375 (Why is no real title available?)
• scientific article; zbMATH DE number 837313 (Why is no real title available?)
• scientific article; zbMATH DE number 1420959 (Why is no real title available?)
• Discrete homing problems
• An optimal threshold policy in applications of a two-state Markov process
• Optimal control problem regularization for the Markov process with finite number of states and constraints
• scientific article; zbMATH DE number 2189769 (Why is no real title available?)
• scientific article; zbMATH DE number 3265247 (Why is no real title available?)
• Controlled Markov Fields with Finite State Space on Graphs
• Optimization and Games for Controllable Markov Chains
• Controlled two-dimensional Markov chains between two absorbing barriers
• Optimal open loop Markov decision rules may require parametric excitation
• Towards the optimal control of Markov chains with constraints
• Optimal Markov strategies for controlled Ito processes
• Markov decision processes with multiple costs
• Aspects of control for the normal Markov processes

This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4945343)