Learning output reference model tracking for higher-order nonlinear systems with unknown dynamics
Summary: Linearly and nonlinearly parameterized approximate dynamic programming approaches used for output reference model (ORM) tracking control are proposed. The ORM tracking problem is of significant interest in practice since, with a linear ORM, the closed-loop control system is indirectly feedback linearized and value iteration (VI) offers the means to achieve ORM tracking without using process dynamics. Ranging from linear to nonlinear parameterizations, a successful approximate VI implementation for continuous state-action spaces depends on several key parameters such as: problem dimension, exploration of the state-action space, the state-transitions dataset size, and suitable selection of the function approximators. We show that using the same transitions dataset and under a general linear parameterization of the Q-function, high performance ORM tracking can be achieved with an approximate VI scheme, on the same performance level as that of a neural-network (NN)-based implementation that is more complex and takes significantly more time to learn. However, the latter proves to be more robust to hyperparameters selection, dataset size, and to exploration strategies, recommending it as the \textit{de facto} practical implementation. The case study is aimed at ORM tracking of a real-world nonlinear two inputs -- two outputs aerodynamic process with ten internal states, as a representative high order system.
- Nonlinear robust approximate optimal tracking control based on adaptive dynamic programming
- Output feedback tracking control of a class of continuous-time nonlinear systems via adaptive dynamic programming approach
- Adaptive dynamic programming for model-free tracking of trajectories with time-varying parameters
- Optimal tracking control based on approximate dynamic programming for unknown system
- Optimal output tracking control of linear discrete-time systems with unknown dynamics by adaptive dynamic programming and output feedback
- Data-driven adaptive dynamic programming for partially observable nonzero-sum games via \(Q\)-learning method
- Data‐driven multivariable ILC: enhanced performance by eliminating L and Q filters
- scientific article; zbMATH DE number 5957269 (Why is no real title available?)
- scientific article; zbMATH DE number 1321699 (Why is no real title available?)
- Iterative feedback tuning—an overview
- Model-free adaptive control design for nonlinear discrete-time processes with reinforcement learning techniques
- Model-free control performance improvement using virtual reference feedback tuning and reinforcement Q-learning
- On ramp metering: towards a better understanding of ALINEA via model-free control
- Reinforcement \(Q\)-learning for optimal tracking control of linear discrete-time systems with unknown dynamics
- Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers
- Reinforcement learning. An introduction
- Virtual reference feedback tuning for non-minimum phase plants
- Virtual reference feedback tuning: A direct method for the design of feedback controllers
This page was built for publication: Learning output reference model tracking for higher-order nonlinear systems with unknown dynamics
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2004902)
