Adaptive control of Markov chains, I: Finite parameter set

DOI10.1109/TAC.1979.1102191MaRDI QIDQ3206798zbMATH OpenOpenAlexFDO

Authors Vivek Borkar, Pravin Varaiya

Publication date 1979

Published in IEEE Transactions on Automatic Control (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1109/tac.1979.1102191

zbMATH Keywords

adaptive control of Markov chains

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Adaptive control/observation systems (93C40) Stochastic systems in control theory (general) (93E03)

Cited in

(17)

• Sample complexity for Markov chain self-tuner
• Will the self-tuning approach work for general cost criteria?
• A note on the structure of two subsets of the parameter space in adaptive control problems
• The Kumar-Becker-Lin scheme revisited
• Self-tuning control of diffusions without the identifiability condition
• Adaptive control of Markov chains with local updates
• On incomplete learning and certainty-equivalence control
• Bounds for the regret loss in dynamic programming under adaptive control
• Adaptive LQ control: Conflict between identification and control
• Adaptive service rate control of an \(M/M/1\) queue with server breakdowns
• Ergodic and adaptive control of nearest-neighbor motions
• Parameter estimation in stochastic systems: some recent results and applications
• A perspective on convergence of adaptive control algorithms
• scientific article; zbMATH DE number 3784748 (Why is no real title available?)
• On the Milito-Cruz adaptive control scheme for Markov chains
• Revisiting the ODE method for recursive algorithms: fast convergence using quasi stochastic approximation
• Estimation and control in discounted stochastic dynamic programming

This page was built for publication: Adaptive control of Markov chains, I: Finite parameter set

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3206798)