Analysis of averages over distributions of Markov processes

DOI10.1016/J.AUTOMATICA.2018.09.016MaRDI QIDQ1716623zbMATH OpenOpenAlexFDO

Authors Patricio E. Valenzuela, Cristian R. Rojas, Håkan Hjalmarsson

Publication date 5 February 2019

Published in Automatica (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.automatica.2018.09.016

zbMATH Keywords

system identificationMarkov chainsinput design

Mathematics Subject Classification ID

Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Markov and semi-Markov decision processes (90C40) Design techniques (robust design, computer-aided design, etc.) (93B51) Nonlinear systems in control theory (93C10) Identification in stochastic control theory (93E12)

Recommendations

• Approximating Markov Processes by Averaging
• Approximating Markov processes by averaging
• scientific article; zbMATH DE number 3903705
• Averaging for some simple constrained Markov processes
• Averaging along a Markov chain
• scientific article; zbMATH DE number 4169792
• On certain average characteristics of finite continuous-time Markov chains
• Moderate deviations of inhomogeneous functionals of Markov processes and application to averaging.
• Means and variances of time averages in Markovian environments

Cites work

• scientific article; zbMATH DE number 3126094 (Why is no real title available?)
• scientific article; zbMATH DE number 1348599 (Why is no real title available?)
• scientific article; zbMATH DE number 700091 (Why is no real title available?)
• scientific article; zbMATH DE number 3085434 (Why is no real title available?)
• A convex analytic approach to Markov decision processes
• A graph theoretical approach to input design for identification of nonlinear dynamical models
• Convergence analysis of parametric identification methods
• Lyapunov Measure for Almost Everywhere Stability
• Markov chains and stochastic stability
• Nonlinear Optimal Control via Occupation Measures and LMI-Relaxations
• Nonlinear Stabilization via Control Lyapunov Measure

Cited in

(1)

• Averaging along a Markov chain

This page was built for publication: Analysis of averages over distributions of Markov processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1716623)