Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems

DOI10.1016/j.neunet.2009.03.008zbMath1335.93068OpenAlexW2081514674WikidataQ45776239 ScholiaQ45776239MaRDI QIDQ280322

Draguna Vrabie, Frank L. Lewis

Publication date: 10 May 2016

Published in: Neural Networks (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.neunet.2009.03.008

zbMATH Keywords

neural networkspolicy iterationdirect adaptive optimal controlonline control

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20) Nonlinear systems in control theory (93C10) Adaptive control/observation systems (93C40)

Related Items

Homotopic policy iteration-based learning design for unknown linear continuous-time systems ⋮ Robust differential game guidance laws design for uncertain interceptor-target engagement via adaptive dynamic programming ⋮ A review of stochastic algorithms with continuous value function approximation and some new approximate policy iteration algorithms for multidimensional continuous applications ⋮ On integral generalized policy iteration for continuous-time linear quadratic regulations ⋮ Distributed optimal control for continuous-time nonaffine nonlinear interconnected systems ⋮ Approximate guaranteed cost fault-tolerant control of unknown nonlinear systems with time-varying actuator faults ⋮ Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming ⋮ \(H^\infty\) filter for discrete-time Takagi-Sugeno fuzzy systems with time-varying delays via a novel Wirtinger-based inequality ⋮ Disturbance observer-based robust missile autopilot design with full-state constraints via adaptive dynamic programming ⋮ Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics ⋮ Two-phase iteration for value function approximation and hyperparameter optimization in Gaussian-kernel-based adaptive critic design ⋮ Reinforcement learning solution for HJB equation arising in constrained optimal control problem ⋮ Simplified optimized control using reinforcement learning algorithm for a class of stochastic nonlinear systems ⋮ Data‐Driven Adaptive Critic Approach for Nonlinear Optimal Control via Least Squares Support Vector Machine ⋮ Policy iterations for reinforcement learning problems in continuous time and space -- fundamental theory and methods ⋮ Self-triggering adaptive optimal control for nonlinear systems based on encoding mechanism ⋮ Suboptimal control for nonlinear systems with disturbance via integral sliding mode control and policy iteration ⋮ Simultaneous identification and optimal tracking control of unknown continuous-time systems with actuator constraints ⋮ An iterative \(\varepsilon\)-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state ⋮ Approximate neural optimal control with reinforcement learning for a torsional pendulum device ⋮ Approximately adaptive neural cooperative control for nonlinear multiagent systems with performance guarantee ⋮ Robust min-max optimal control design for systems with uncertain models: a neural dynamic programming approach ⋮ Reinforcement learning for robust stabilization of nonlinear systems with asymmetric saturating actuators ⋮ A New Integral Critic Learning for Optimal Tracking Control with Applications to Boiler‐Turbine Systems ⋮ Nonlinear fractional optimal control problems with neural network and dynamic optimization schemes ⋮ A brief review of neural networks based learning and control and their applications for robots ⋮ Adaptive dynamic programming‐based event‐triggered optimal tracking control ⋮ Online inverse reinforcement learning for nonlinear systems with adversarial attacks ⋮ Continuous‐time receding‐horizon reinforcement learning and its application to path‐tracking control of autonomous ground vehicles ⋮ Learning‐based T‐sHDP() for optimal control of a class of nonlinear discrete‐time systems ⋮ Model‐free incremental adaptive dynamic programming based approximate robust optimal regulation ⋮ Optimal tracking control of mechatronic servo system using integral reinforcement learning ⋮ Nonlinear control using human behavior learning ⋮ Optimal control of unknown nonlinear system under event‐triggered mechanism and identifier‐critic‐actor architecture ⋮ Optimization‐based adaptive control for MIMO nonlinear systems: A data‐driven method ⋮ Event-triggered-based online integral reinforcement learning for optimal control of unknown constrained nonlinear systems ⋮ Event-triggered distributed robust optimal control of nonholonomic mobile agents with obstacle avoidance formation, input constraints and external disturbances ⋮ Controllability and optimal control of a temporal Boolean network ⋮ Output feedback direct adaptive neural network control for uncertain SISO nonlinear systems using a fuzzy estimator of the control error ⋮ Model-free policy iteration approach to NCE-based strategy design for linear quadratic Gaussian games ⋮ Approximate solution of nonlinear optimal control problems with scale delay function via a composite pseudospectral approach ⋮ \(\mathcal{H}_\infty\) tracking learning control for discrete-time Markov jump systems: a parallel off-policy reinforcement learning ⋮ Fractional type multivariate neural network operators ⋮ Reinforcement learning algorithms with function approximation: recent advances and applications ⋮ Event-triggered optimal control for discrete-time multi-player non-zero-sum games using parallel control ⋮ Improved off‐policy reinforcement learning algorithm for robust control of unmodeled nonlinear system with asymmetric state constraints ⋮ Reinforcement learning‐based optimal trajectory tracking control of surface vessels under input saturations ⋮ Trajectory tracking control for underactuated autonomous vehicles via adaptive dynamic programming ⋮ Integral sliding mode‐based event‐triggered nearly optimal tracking control for uncertain nonlinear systems ⋮ Policy iteration based robust co-design for nonlinear control systems with state constraints ⋮ Output feedback tracking control of a class of continuous-time nonlinear systems via adaptive dynamic programming approach ⋮ Optimized adaptive consensus control for multi-agent systems with prescribed performance ⋮ Lyapunov stability-based control and identification of nonlinear dynamical systems using adaptive dynamic programming ⋮ Predictive control of uncertain nonlinear parabolic PDE systems using a Galerkin/neural-network-based model ⋮ Data-based optimal coordination control of continuous-time nonlinear multi-agent systems via adaptive dynamic programming method ⋮ Dynamic event-triggered adaptive control for uncertain stochastic nonlinear systems ⋮ Reinforcement learning for a class of continuous-time input constrained optimal control problems ⋮ Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learning ⋮ Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systems ⋮ Adaptive dynamic programming and optimal control of nonlinear nonaffine systems ⋮ Integral reinforcement learning-based guaranteed cost control for unknown nonlinear systems subject to input constraints and uncertainties ⋮ Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control ⋮ Planing craft control using pneumatically driven trim tab ⋮ Online concurrent reinforcement learning algorithm to solve two‐player zero‐sum games for partially unknown nonlinear continuous‐time systems ⋮ Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics ⋮ Convergence of the standard RLS method andUDU^Tfactorisation of covariance matrix for solving the algebraic Riccati equation of the DLQR via heuristic approximate dynamic programming ⋮ Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties ⋮ Nearly data-based optimal control for linear discrete model-free systems with delays via reinforcement learning ⋮ Distributed optimal control for nonholonomic systems with input constraints and uncertain interconnections ⋮ Adaptive near-optimal neuro controller for continuous-time nonaffine nonlinear systems with constrained input ⋮ Optimal control for nonlinear continuous systems by adaptive dynamic programming based on fuzzy basis functions ⋮ Observer based adaptive dynamic programming for fault tolerant control of a class of nonlinear systems ⋮ Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems ⋮ Intelligent Human–Robot Interaction Systems Using Reinforcement Learning and Neural Networks ⋮ Integral reinforcement learning based event-triggered control with input saturation ⋮ Model-FreeH_∞Control Design for Unknown Continuous-Time Linear System Using Adaptive Dynamic Programming ⋮ Optimal synchronization controller design for complex dynamical networks with unknown system dynamics ⋮ A solution to the path planning problem via algebraic geometry and reinforcement learning ⋮ Fuel-optimal control for soft lunar landing based on a quadratic regularization approach ⋮ Online optimal tracking control of continuous-time linear systems with unknown dynamics by using adaptive dynamic programming ⋮ Computationally efficient simultaneous policy update algorithm for nonlinearH_∞state feedback control with Galerkin's method ⋮ Reinforcement learning for distributed control and multi-player games ⋮ From reinforcement learning to optimal control: a unified framework for sequential decisions ⋮ Adaptive dynamic programming in the Hamiltonian-driven framework ⋮ Computational intelligence in uncertainty quantification for learning control and differential games ⋮ A hybrid dynamical systems perspective on reinforcement learning for cyber-physical systems: vistas, open problems, and challenges ⋮ Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design ⋮ Approximate optimal trajectory tracking for continuous-time nonlinear systems ⋮ Neural-network-observer-based optimal control for unknown nonlinear systems using adaptive dynamic programming

Cites Work

• Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• L/sub 2/-gain analysis of nonlinear systems and nonlinear state-feedback H/sub infinity / control
• Numerical approach to computing nonlinear H-infinity control laws
• Policy Iterations on the Hamilton–Jacobi–Isaacs Equation for $H_{\infty}$ State Feedback Control With Input Saturation
• Construction of Suboptimal Control Sequences
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item