Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

DOI10.1016/j.automatica.2012.05.049zbMath1269.49042OpenAlexW2132858840MaRDI QIDQ2391487

Ding Wang, Qinglai Wei, Ning Jin, Dongbin Zhao, Derong Liu

Publication date: 31 July 2013

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: http://www.sciencedirect.com/science/article/pii/S0005109812002221

zbMATH Keywords

optimal controlneural networkintelligent controlapproximate dynamic programmingadaptive dynamic programmingadaptive critic designsglobalized dual heuristic programming

Mathematics Subject Classification ID

Dynamic programming in optimal control and differential games (49L20) Nonlinear systems in control theory (93C10) Discrete-time control/observation systems (93C55) Dynamic programming (90C39)

Related Items (61)

Online identifier–actor–critic algorithm for optimal control of nonlinear systems ⋮ Optimal tracking control based on reinforcement learning value iteration algorithm for time-delayed nonlinear systems with external disturbances and input constraints ⋮ Generalized value iteration for discounted optimal control with stability analysis ⋮ On integral generalized policy iteration for continuous-time linear quadratic regulations ⋮ Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design ⋮ Efficient model-based reinforcement learning for approximate online optimal control ⋮ Optimal scheduling for reference tracking or state regulation using reinforcement learning ⋮ Two-phase iteration for value function approximation and hyperparameter optimization in Gaussian-kernel-based adaptive critic design ⋮ A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization ⋮ Novel iterative neural dynamic programming for data-based approximate optimal control design ⋮ Finite-horizon LQ control for unknown discrete-time linear systems via extremum seeking ⋮ Radial basis function networks simulation of age-structure population ⋮ Novel optimal trajectory tracking for nonlinear affine systems with an advanced critic learning structure ⋮ Quantized optimal output feedback control and optimal triggering signal co‐design for unknown discrete‐time nonlinear systems ⋮ Neural optimal tracking control of constrained nonaffine systems with a wastewater treatment application ⋮ Neural-network-based discounted optimal control via an integrated value iteration with accuracy guarantee ⋮ A brief review of neural networks based learning and control and their applications for robots ⋮ A signomial programming-based approach for multi-echelon supply chain disruption risk assessment with robust dynamic Bayesian network ⋮ Value‐iteration‐based affine nonlinear optimal control involving admissibility discussion ⋮ Event‐trigger‐based approximate optimal control of modular robot manipulators using zero‐sum game ⋮ Continuous‐time receding‐horizon reinforcement learning and its application to path‐tracking control of autonomous ground vehicles ⋮ Discounted near‐optimal regulation of constrained nonlinear systems via generalized value iteration ⋮ Complete stability analysis of a heuristic approximate dynamic programming control design ⋮ Robust tracking control of quadrotor via on‐policy adaptive dynamic programming ⋮ Optimal output tracking control of linear discrete-time systems with unknown dynamics by adaptive dynamic programming and output feedback ⋮ A novel actor-critic-identifier architecture for nonlinear multiagent systems with gradient descent method ⋮ Adaptive critic control with multi‐step policy evaluation for nonlinear zero‐sum games ⋮ Optimal couple-group tracking control for the heterogeneous multi-agent systems with cooperative-competitive interactions via reinforcement learning method ⋮ Event-triggered-based online integral reinforcement learning for optimal control of unknown constrained nonlinear systems ⋮ Robust adaptive critic control design with network-based event-triggered formulation ⋮ Model‐free optimal tracking over finite horizon using adaptive dynamic programming ⋮ Multi‐event‐triggered adaptive critic control with guaranteed cost for discrete‐time nonlinear nonzero‐sum games ⋮ Optimal trajectory tracking control for a class of nonlinear nonaffine systems via generalized N‐step value gradient learning ⋮ Convergence analysis of the deep neural networks based globalized dual heuristic programming ⋮ A novel optimal tracking control scheme for a class of discrete-time nonlinear systems using generalised policy iteration adaptive dynamic programming algorithm ⋮ Parabola-Based Flue Gas Temperature Modeling and Its Application in BTP Control of a Sintering Process ⋮ A Q-learning predictive control scheme with guaranteed stability ⋮ Adaptive dynamic programming and optimal control of nonlinear nonaffine systems ⋮ Impedance model-based optimal regulation on force and position of bimanual robots to hold an object ⋮ Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming ⋮ Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control ⋮ Optimal control of complex systems based on improved dual heuristic dynamic programming algorithm ⋮ Online H∞ control for completely unknown nonlinear systems via an identifier–critic-based ADP structure ⋮ Online concurrent reinforcement learning algorithm to solve two‐player zero‐sum games for partially unknown nonlinear continuous‐time systems ⋮ Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics ⋮ Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties ⋮ Stackelberg games for model-free continuous-time stochastic systems based on adaptive dynamic programming ⋮ A novel optimal bipartite consensus control scheme for unknown multi-agent systems via model-free reinforcement learning ⋮ Adaptive T-S fuzzy controller using reinforcement learning based on Lyapunov stability ⋮ Decentralized adaptive optimal stabilization of nonlinear systems with matched interconnections ⋮ Adaptive near-optimal neuro controller for continuous-time nonaffine nonlinear systems with constrained input ⋮ Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems ⋮ A model-free distributed cooperative frequency control strategy for MT-HVDC systems using reinforcement learning method ⋮ Online optimal tracking control of continuous-time linear systems with unknown dynamics by using adaptive dynamic programming ⋮ Adaptive optimal tracking controls of unknown multi-input systems based on nonzero-sum game theory ⋮ Discrete-time online learning control for a class of unknown nonaffine nonlinear systems using reinforcement learning ⋮ Multi-agent discrete-time graphical games and reinforcement learning solutions ⋮ Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design ⋮ Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints ⋮ Data-driven adaptive dynamic programming for partially observable nonzero-sum games via Q-learning method ⋮ Multi-objective optimal control for a class of nonlinear time-delay systems via adaptive dynamic programming

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems
• Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence
• An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games
• Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
• Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
• \({\mathcal Q}\)-learning
• On infinite-time nonlinear quadratic optimal control
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• A receding horizon generalization of pointwise min-norm controllers
• Adaptive-critic-based neural networks for aircraft optimal control

This page was built for publication: Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming