The \mathcal{H}_2-optimal Control Problem of CSVIU Systems: Discounted, Counterdiscounted, and Long-Run Solutions

DOI10.1137/21M1434593MaRDI QIDQ5097386zbMATH OpenOpenAlexFDO

Authors D. Campos, João B. R. do Val

Publication date 23 August 2022

Published in SIAM Journal on Control and Optimization (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2106.13806

zbMATH Keywords

\(\mathcal{H}_2\)-norm controlnondifferentiable optimizationoptimal stochastic controlstochastic stabilizationuncertain system

Mathematics Subject Classification ID

Stabilization of systems by feedback (93D15) Stochastic stability in control theory (93E15) Optimal stochastic control (93E20)

Abstract: The paper deals with stochastic control problems associated with $H_2$ performance indices such as energy or power norms or energy measurements when norms are not defined. They apply to a class of systems for which a stochastic process conveys the underlying uncertainties, known as CSVIU (Control and State Variation Increase Uncertainty). These indices allow various emphases from focusing on the transient behavior with the discounted norm to stricter conditions on stability, steady-state mean-square error and convergence rate, using the optimal overtaking criterion -- the long-run average power control stands as a midpoint in this respect. A critical advance regards the explicit form of the optimal control law, expressed in two equivalent forms. One takes a perturbed affine Riccati-like form of feedback solution; the other comes from a generalized normal equation that arises from the nondifferentiable local optimal problem. They are equivalent, but the latter allows for a search method to attain the optimal law. A detectability notion and a Riccati solution grant stochastic stability from the behavior of the norms. The energy overtaking criterion requires a further constraint on a matrix spectral radius. With these findings, the paper revisits the emerging of the inaction solution, a prominent feature of CSVIU models to deal with the uncertainty inherent to poorly known models. Besides, it provides the optimal solution and the tools to pursue it.

Recommendations

• H₂optimal control for a wide class of discrete-time linear stochastic systems
• \(\mathcal{H}_2\) optimal control for generalized discrete-time systems
• Existence and structure of solutions for a class of optimal control systems with discounting arising in economic dynamics
• Mixed H₂/_1 optimization problems for SISO discrete time control systems
• Mixed \({\mathcal H}_ 2/{\mathcal H}_{\infty}\) control for discrete-time systems via convex optimization
• Existence of solutions for a class of infinite horizon optimal control problems with discounting
• Finite-Horizon Discounted Optimal Control: Stability and Performance
• scientific article; zbMATH DE number 828035
• Optimal solutions fo constrained discounted semi-Markov control problems
• Solution of an optimal control problem for a class of discrete stochastic two-parameter systems

Cites work

• Convex Analysis
• Detectability and observability of discrete-time stochastic systems and their applications
• Exact detectability and exact observability of discrete-time linear stochastic systems with periodic coefficients
• Fishery management under poorly known dynamics
• scientific article; zbMATH DE number 46303 (Why is no real title available?)
• scientific article; zbMATH DE number 50111 (Why is no real title available?)
• scientific article; zbMATH DE number 51863 (Why is no real title available?)
• scientific article; zbMATH DE number 1542660 (Why is no real title available?)
• scientific article; zbMATH DE number 2136426 (Why is no real title available?)
• scientific article; zbMATH DE number 960192 (Why is no real title available?)
• Infinite horizon linear quadratic overtaking optimal control problems
• Iterative solution of large sparse systems of equations
• Markov chains and stochastic stability
• Mathematical Methods in Robust Control of Discrete-Time Linear Stochastic Systems
• Mathematical methods in robust control of linear stochastic systems.
• Modeling and Control of Stochastic Systems With Poorly Known Dynamics
• On detectability of stochastic systems
• Perturbation Theory for Linearly Perturbed Algebraic Riccati Equations
• Properties of the solutions of rational matrix difference equations
• Robust control of uncertain systems: classical results and recent developments
• Robust control theory. Based on the proceedings of a workshop that was an integral part of the 1992-93 IMA program on control theory, University of Minnesota, MN, USA
• Stochastic H₂/H_ control: a Nash game approach
• Stochastic stability of differential equations. With contributions by G. N. Milstein and M. B. Nevelson
• When control and state variations increase uncertainty: modeling and stochastic control in discrete time

Cited in

(3)

• When control and state variations increase uncertainty: modeling and stochastic control in discrete time
• Limit equations of adaptive Erlangization and their application to environmental management
• The H∞‐optimal control problem of CSVIU systems

This page was built for publication: The $\mathcal{H}_2$-optimal Control Problem of CSVIU Systems: Discounted, Counterdiscounted, and Long-Run Solutions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5097386)