Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints

DOI10.1080/00207179.2013.848292zbMath1317.93158OpenAlexW1977237536MaRDI QIDQ5265704

Xiong Yang, Ding Wang, Derong Liu

Publication date: 28 July 2015

Published in: International Journal of Control (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1080/00207179.2013.848292

zbMATH Keywords

optimal controladaptive controlneural networksinput constraintsreinforcement learning

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05) Applications of optimal control and differential games (49N90) Nonlinear systems in control theory (93C10) Adaptive control/observation systems (93C40) Control/observation systems governed by ordinary differential equations (93C15)

Related Items (32)

Optimal tracking control based on reinforcement learning value iteration algorithm for time-delayed nonlinear systems with external disturbances and input constraints ⋮ Backstepping-based adaptive dynamic programming for missile-target guidance systems with state and input constraints ⋮ Event-triggered adaptive dynamic programming for multi-player zero-sum games with unknown dynamics ⋮ Efficient model-based reinforcement learning for approximate online optimal control ⋮ Disturbance observer-based robust missile autopilot design with full-state constraints via adaptive dynamic programming ⋮ A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization ⋮ Reinforcement learning solution for HJB equation arising in constrained optimal control problem ⋮ Simultaneous identification and optimal tracking control of unknown continuous-time systems with actuator constraints ⋮ Review of works by V. A. Yakubovich's scientific school on artificial intelligence and robotics ⋮ Event-triggered-based online integral reinforcement learning for optimal control of unknown constrained nonlinear systems ⋮ Policy iteration reinforcement learning-based control using a grey wolf optimizer algorithm ⋮ An approach to solving optimal control problems of nonlinear systems by introducing detail-reward mechanism in deep reinforcement learning ⋮ Adaptive dynamic surface-based differential games for a class of pure-feedback nonlinear systems with output constraints ⋮ Optimal control of partially unknown constrained‐input systems: A dynamic event‐triggered‐based approach ⋮ Performance‐guaranteed containment control for pure‐feedback multi agent systems via reinforcement learning algorithm ⋮ Optimized tracking control based on reinforcement learning for a class of high-order unknown nonlinear dynamic systems ⋮ Event‐based robust performance guarantee for nonaffine plants via system identification ⋮ Output feedback tracking control of a class of continuous-time nonlinear systems via adaptive dynamic programming approach ⋮ Robust adaptive control of strict-feedback nonlinear systems with unmodelled dynamics and time-varying delays ⋮ An approximate dynamic programming approach to resource management in multi-cloud scenarios ⋮ Designing of robust adaptive passivity-based controller based on reinforcement learning for nonlinear port-Hamiltonian model with disturbance ⋮ Distributed adaptive dynamic programming for data-driven optimal control ⋮ Two-phase selective decentralization to improve reinforcement learning systems with MDP ⋮ Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming ⋮ Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control ⋮ Online approximate solution of HJI equation for unknown constrained-input nonlinear continuous-time systems ⋮ Online H∞ control for completely unknown nonlinear systems via an identifier–critic-based ADP structure ⋮ Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics ⋮ Data-based robust adaptive control for a class of unknown nonlinear constrained-input systems via integral reinforcement learning ⋮ Adaptive dynamic programming-based stabilization of nonlinear systems with unknown actuator saturation ⋮ Adaptive optimal tracking controls of unknown multi-input systems based on nonzero-sum game theory ⋮ Adaptive dynamic programming-based decentralised control for large-scale nonlinear systems subject to mismatched interconnections with unknown time-delay

Cites Work

• Unnamed Item
• Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence
• Constrained adaptive optimal control using a reinforcement learning agent
• Optimality and convergence of adaptive optimal control by reinforcement synthesis
• An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games
• Adaptive dynamic programming for control. Algorithms and stability
• A single network adaptive critic (SNAC) architecture for optimal control synthesis for a class of nonlinear systems
• Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
• Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
• Multilayer feedforward networks are universal approximators
• A robust adaptive nonlinear control design
• An iterative \(\varepsilon\)-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state
• A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems
• An iterative adaptive dynamic programming algorithm for optimal control of unknown discrete-time nonlinear systems with constrained inputs
• Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• Online solution of nonquadratic two-player zero-sum games arising in theH_∞control of constrained input systems
• An integrated optimal control algorithm for discrete-time nonlinear stochastic system
• Approximate Dynamic Programming
• Integrated nonlinear optimal control of spacecraft in proximity operations
• Recent Advances in Intelligent Control Systems
• Reinforcement learning control using interconnected learning automata
• An almost optimal control design method for nonlinear time-delay systems
• Nonlinear and locally optimal controllers design for input affine locally controllable systems

This page was built for publication: Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints