On the Certainty-Equivalence Approach to Direct Data-Driven LQR Design
From MaRDI portal
Abstract: The linear quadratic regulator (LQR) problem is a cornerstone of automatic control, and it has been widely studied in the data-driven setting. The various data-driven approaches can be classified as indirect (i.e., based on an identified model) versus direct or as robust (i.e., taking uncertainty into account) versus certainty-equivalence. Here we show how to bridge these different formulations and propose a novel, direct, and regularized formulation. We start from indirect certainty-equivalence LQR, i.e., least-square identification of state-space matrices followed by a nominal model-based design, formalized as a bi-level program. We show how to transform this problem into a single-level, regularized, and direct data-driven control formulation, where the regularizer accounts for the least-square data fitting criterion. For this novel formulation we carry out a robustness and performance analysis in presence of noisy data. Our proposed direct and regularized formulation is also amenable to be further blended with a robust-stability-promoting regularizer. In a numerical case study we compare regularizers promoting either robustness or certainty-equivalence, and we demonstrate the remarkable performance when blending both of them.
Cited in
(12)- How to improve robust control of a linear time-varying system by using experimental data
- Input-output data-driven consensus control of multiagent systems under switching communication network topologies
- Distributed algorithms for solving linear algebraic equations: an optimal control perspective
- Quasi-data-driven static output feedback control of linear systems with input and state delays
- Derivative-free data-driven control of continuous-time linear time-invariant systems
- Optimal control of continuous-time symmetric systems with unknown dynamics and noisy measurements
- Data-driven robust linear quadratic regulator: a minimax design using reinforcement learning
- Robust \(H_{\infty}\) control with transients for LTV systems based on prior knowledge and data
- Data-driven model predictive control with reinforcement learning for linear time-invariant systems
- Distributed integral observer-based data-driven control for multi-agent systems under denial-of-service attacks
- Stability-certified on-policy data-driven LQR via recursive learning and policy gradient
- A switched system approach to robust data-driven control for time-varying delay systems under denial-of-service attacks
This page was built for publication: On the Certainty-Equivalence Approach to Direct Data-Driven LQR Design
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6199985)
