Discretization procedures for adaptive Markov control processes

DOI10.1016/0022-247X(89)90259-XzbMATH Open0677.93073OpenAlexW2032419970MaRDI QIDQ1123872FDOQ1123872

Authors: Steven I. Marcus, Onésimo Hernández-Lerma 

Publication date: 1989

Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/0022-247x(89)90259-x

Recommendations

• scientific article; zbMATH DE number 4123661
• Adaptive Markov control processes
• Adaptive control of discrete time Markov processes by the large deviations method
• Adaptive control for discrete-time Markov processes with unbounded costs: Discounted criterion.
• scientific article; zbMATH DE number 4031438

zbMATH Keywords

parameter estimationdiscrete-timeinfinite horizonasymptotically optimaluniform approximationsadaptive Markov control processesunknown disturbance distribution

Mathematics Subject Classification ID

Discrete-time Markov processes on general state spaces (60J05) Adaptive control/observation systems (93C40)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Stochastic optimal control. The discrete time case
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Convergence of Dynamic Programming Models
• Convergence of discretization procedures in dynamic programming
• Approximations of Dynamic Programs, I
• Approximations of Dynamic Programs, II
• Optimal Plans for Dynamic Programming Problems
• Estimation and control in Markov chains
• Estimation and control in discounted stochastic dynamic programming
• Title not available (Why is that?)
• Empirical processes: A survey of results for independent and identically distributed random variables
• Title not available (Why is that?)
• Strongly consistent estimation in a controlled Markov renewal model
• Nonstationary Markov decision problems with converging parameters
• Adaptive control of discounted Markov decision chains
• Adaptive policies for discrete-time stochastic control systems with unknown disturbance distribution
• Continuous dependence of stochastic control models on the noise distribution
• Approximation and bounds in discrete event dynamic programming
• Title not available (Why is that?)
• An Approach to Discrete-Time Stochastic Control Problems under Partial Observation

Cited In (6)

• Adaptive control of discrete time Markov processes by the large deviations method
• Adaptive Markov control processes
• A perturbation approach to approximate value iteration for average cost Markov decision processes with Borel spaces and bounded costs
• A convex optimization approach to dynamic programming in continuous state and action spaces
• Value iteration in average cost Markov control processes on Borel spaces
• Note on stability estimation in average Markov control processes.

This page was built for publication: Discretization procedures for adaptive Markov control processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1123872)