Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach

DOI10.1016/J.AUTOMATICA.2004.11.034zbMath1087.49022OpenAlexW2108286682MaRDI QIDQ2576080

Murad Abu-Khalaf, Frank L. Lewis

Publication date: 8 December 2005

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.automatica.2004.11.034

zbMATH Keywords

Hamilton-Jacobi-Bellman equationLyapunov equationneural networkleast squaresactuator saturationinfinite horizon controlconstrained input systems

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Neural networks for/in biological studies, artificial life and related topics (92B20) Nonlinear systems in control theory (93C10)

Related Items (only showing first 100 items - show all)

Online identifier–actor–critic algorithm for optimal control of nonlinear systems ⋮ Robust differential game guidance laws design for uncertain interceptor-target engagement via adaptive dynamic programming ⋮ Distributed optimized dynamic event-triggered control for unknown heterogeneous nonlinear MASs with input-constrained ⋮ Reinforcement learning for robust stabilization of nonlinear systems with asymmetric saturating actuators ⋮ Performance‐based optimal control for stochastic nonlinear systems with unknown dead‐zone ⋮ Quantized optimal output feedback control and optimal triggering signal co‐design for unknown discrete‐time nonlinear systems ⋮ Adaptive-critic-based model reference control for unknown nonlinear systems with input constraints ⋮ Off‐policy integral reinforcement learning‐based optimal tracking control for a class of nonzero‐sum game systems with unknown dynamics ⋮ A New Integral Critic Learning for Optimal Tracking Control with Applications to Boiler‐Turbine Systems ⋮ Adaptive neural optimal tracking control of stochastic nonstrict-feedback nonlinear systems with output constraints ⋮ Modified general policy iteration based adaptive dynamic programming for unknown discrete‐time linear systems ⋮ Suboptimal reduced control of unknown nonlinear singularly perturbed systems via reinforcement learning ⋮ Online inverse reinforcement learning for nonlinear systems with adversarial attacks ⋮ Intelligent optimal tracking with asymmetric constraints of a nonlinear wastewater treatment system ⋮ Learning‐based T‐sHDP() for optimal control of a class of nonlinear discrete‐time systems ⋮ Model‐free incremental adaptive dynamic programming based approximate robust optimal regulation ⋮ Optimal tracking control of mechatronic servo system using integral reinforcement learning ⋮ Event‐driven adaptive near‐optimal tracking control of the robot in aircraft skin inspection ⋮ Integral reinforcement learning‐based approximate minimum time‐energy path planning in an unknown environment ⋮ Event‐triggered optimal tracking control of multiplayer unknown nonlinear systems via adaptive critic designs ⋮ Optimal game theoretic solution of the pursuit‐evasion intercept problem using on‐policy reinforcement learning ⋮ Optimal control of unknown nonlinear system under event‐triggered mechanism and identifier‐critic‐actor architecture ⋮ Event-triggered constrained neural critic control of nonlinear continuous-time multiplayer nonzero-sum games ⋮ Region-based approximation in approximate dynamic programming ⋮ Approximate Q Learning for Controlled Diffusion Processes and Its Near Optimality ⋮ Reinforcement learning‐based robust optimal output regulation for constrained nonlinear systems with static and dynamic uncertainties ⋮ Observer‐based event triggered ADP approach for input‐constrained nonlinear systems with disturbances ⋮ Prescribed performance event-triggered fuzzy optimal tracking control for strict-feedback nonlinear systems ⋮ Event-triggered distributed robust optimal control of nonholonomic mobile agents with obstacle avoidance formation, input constraints and external disturbances ⋮ Event-triggered design for discrete-time nonlinear systems with control constraints ⋮ Data-driven \(H_\infty\) vibration control design and verification for an active suspension system with unknown pseudo-drift dynamics ⋮ Improved off‐policy reinforcement learning algorithm for robust control of unmodeled nonlinear system with asymmetric state constraints ⋮ Reinforcement learning‐based optimal trajectory tracking control of surface vessels under input saturations ⋮ Trajectory tracking control for underactuated autonomous vehicles via adaptive dynamic programming ⋮ Reinforcement learning‐based tracking control for a quadrotor unmanned aerial vehicle under external disturbances ⋮ Differential dynamic programming for finite‐horizon zero‐sum differential games of nonlinear systems ⋮ Robust dynamic event‐triggered control of saturated nonlinear systems using reinforcement learning ⋮ Reinforcement learning based optimal synchronization control for multi-agent systems with input constraints using vanishing viscosity method ⋮ Neural network solution for finite-horizonH_∞state feedback control of nonlinear systems ⋮ Explicit constructions of global stabilization and nonlinear H_∞ control laws for a class of nonminimum phase nonlinear multivariable systems ⋮ Online solution of nonlinear two‐player zero‐sum games using synchronous policy iteration ⋮ Online H∞ control for completely unknown nonlinear systems via an identifier–critic-based ADP structure ⋮ Optimal antisynchronization control for unknown multiagent systems with deep deterministic policy gradient approach ⋮ Decentralized optimal tracking control for large-scale nonlinear systems with tracking error constraints ⋮ Data-driven ensemble optimal compensation control for partially known delayed and persistently disturbed nonlinear systems ⋮ Parametrized guaranteed cost method with prescribed performance via critic-only ADP for uncertain nonlinear systems and disturbances ⋮ Two-player nonlinear Stackelberg differential game via off-policy integral reinforcement learning ⋮ Adaptive fault-tolerant optimal control for hypersonic vehicles with state constrains based on adaptive dynamic programming ⋮ A spectral iterative algorithm for solving constrained optimal control problems with nonquadratic functional ⋮ Infinite time linear quadratic Stackelberg game problem for unknown stochastic discrete-time systems via adaptive dynamic programming approach ⋮ A model-free deep integral policy iteration structure for robust control of uncertain systems ⋮ Robust control for a class of nonlinear systems with input constraints based on actor-critic learning ⋮ Solution for optimal control of general nonlinear systems using generating functions ⋮ Sum-of-squares-based policy iteration for suboptimal control of polynomial time-varying systems ⋮ Input-constrained optimal output synchronization of heterogeneous multiagent systems via observer-based model-free reinforcement learning ⋮ On the effect of clock offsets and quantization on learning-based adversarial games ⋮ Event-triggered distributed \(H_\infty\) control of physically interconnected mobile Euler-Lagrange systems with slipping, skidding and dead zone ⋮ Near optimal tracking control of a class of non-linear systems and an experimental comparison ⋮ \(H_\infty\) tracking control via variable gain gradient descent-based integral reinforcement learning for unknown continuous time non-linear system ⋮ Minimum loss optimization of flywheel energy storage systems via distributed adaptive dynamic programming ⋮ Data-driven distributed optimal control using neighbourhood optimization for nonlinear interconnected systems ⋮ Dual-loop adaptive dynamic programming for autonomous vehicle trajectory following control against actuator faults ⋮ Finite-time optimal control for a class of nonlinear systems with performance constraints via critic-only ADP: theory and experiments ⋮ Firefly optimized neural network-based trajectory tracking control of partially unknown multiplayer nonlinear systems ⋮ Concurrent learning for adaptive Pontryagin's maximum principle of nonlinear systems with inequality constraints ⋮ A new Q-function structure for model-free adaptive optimal tracking control with asymmetric constrained inputs ⋮ Machine learning model-based optimal tracking control of nonlinear affine systems with safety constraints ⋮ Discrete-time optimal control of state-constrained nonlinear systems using approximate dynamic programming ⋮ Robust control of uncertain discrete-time Markovian jump systems with actuator saturation ⋮ The design of suboptimal asymptotic stabilising controllers for nonlinear slowly varying systems ⋮ Asymptotic stabilization of nonlinear systems with convex-polytope input constraints by continuous input ⋮ Optimal tracking control based on reinforcement learning value iteration algorithm for time-delayed nonlinear systems with external disturbances and input constraints ⋮ Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems ⋮ Multi-agent zero-sum differential graphical games for disturbance rejection in distributed control ⋮ Neural network-based adaptive decentralized learning control for interconnected systems with input constraints ⋮ Distributed optimal control for continuous-time nonaffine nonlinear interconnected systems ⋮ Nonzero-sum differential games of continuous-time nonlinear systems with uniformly ultimately \(\varepsilon\)-bounded by adaptive dynamic programming ⋮ Approximate guaranteed cost fault-tolerant control of unknown nonlinear systems with time-varying actuator faults ⋮ Controller design for Markov jumping systems subject to actuator saturation ⋮ Adaptive Optimal Control Without Weight Transport ⋮ A radial basis collocation method for Hamilton-Jacobi-Bellman equations ⋮ Multi-agent differential graphical games: online adaptive learning solution for synchronization with optimality ⋮ Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming ⋮ Adaptive critic designs for decentralised robust control of nonlinear interconnected systems via event-triggering mechanism ⋮ Disturbance observer-based robust missile autopilot design with full-state constraints via adaptive dynamic programming ⋮ General value iteration based single network approach for constrained optimal controller design of partially-unknown continuous-time nonlinear systems ⋮ Neuro-optimal tracking control for a class of discrete-time nonlinear systems via generalized value iteration adaptive dynamic programming approach ⋮ A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization ⋮ Reinforcement learning solution for HJB equation arising in constrained optimal control problem ⋮ Online adaptive algorithm for optimal control with integral reinforcement learning ⋮ A neural network solution for fixed-final time optimal control of nonlinear systems ⋮ Data‐Driven Adaptive Critic Approach for Nonlinear Optimal Control via Least Squares Support Vector Machine ⋮ Policy iterations for reinforcement learning problems in continuous time and space -- fundamental theory and methods ⋮ Suboptimal control for nonlinear systems with disturbance via integral sliding mode control and policy iteration ⋮ Self-learning robust optimal control for continuous-time nonlinear systems with mismatched disturbances ⋮ Neural robust stabilization via event-triggering mechanism and adaptive learning technique ⋮ Adaptive critic designs for optimal control of uncertain nonlinear systems with unmatched interconnections ⋮ Simultaneous identification and optimal tracking control of unknown continuous-time systems with actuator constraints ⋮ A boundedness result for the direct heuristic dynamic programming ⋮ Differential-game for resource aware approximate optimal control of large-scale nonlinear systems with multiple players

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• The method of weighted residuals and variational principles. With application in fluid mechanics, heat and mass transfer
• Approximate solutions to the time-invariant Hamilton-Jacobi-Bellman equation
• Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
• Solving Hamilton-Jacobi-Bellman equations by a modified method of characteristics
• On the Bellman equation for infinite horizon problems with unbounded cost functional
• L/sub 2/-gain analysis of nonlinear systems and nonlinear state-feedback H/sub infinity / control
• An Approximation Theory of Optimal Control for Trainable Manipulators
• Adaptively controlling nonlinear continuous-time systems using multilayer neural networks
• A general result on the stabilization of linear systems using bounded controls
• Performance functionals and dynamic systems' optimization
• Optimal nonlinear, but continuous, feedback control of systems with saturating actuators
• Numerical approach to computing nonlinear H-infinity control laws
• Control of linear systems with saturating actuators
• Stable adaptive neural control scheme for nonlinear systems
• Adaptive control of unknown plants using dynamical neural networks
• Optimal control and viscosity solutions of Hamilton-Jacobi-Bellman equations
• Intelligent optimal control of robotic manipulators using neural networks
• Special issue: Neural network feedback control

This page was built for publication: Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach