Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming

DOI10.1016/j.automatica.2012.05.049zbMath1269.49042MaRDI QIDQ2391487

Ding Wang, Qinglai Wei, Ning Jin, Dongbin Zhao, Derong Liu

Publication date: 31 July 2013

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: http://www.sciencedirect.com/science/article/pii/S0005109812002221

zbMATH Keywords

optimal control; neural network; intelligent control; approximate dynamic programming; adaptive dynamic programming; adaptive critic designs; globalized dual heuristic programming

Mathematics Subject Classification ID

49L20: Dynamic programming in optimal control and differential games

93C10: Nonlinear systems in control theory

93C55: Discrete-time control/observation systems

90C39: Dynamic programming

Related Items

Data-driven adaptive dynamic programming for partially observable nonzero-sum games via Q-learning method, Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control, Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints, Online identifier–actor–critic algorithm for optimal control of nonlinear systems, Parabola-Based Flue Gas Temperature Modeling and Its Application in BTP Control of a Sintering Process, Online optimal tracking control of continuous-time linear systems with unknown dynamics by using adaptive dynamic programming, Online H∞ control for completely unknown nonlinear systems via an identifier–critic-based ADP structure, Online concurrent reinforcement learning algorithm to solve two‐player zero‐sum games for partially unknown nonlinear continuous‐time systems, Radial basis function networks simulation of age-structure population, Novel optimal trajectory tracking for nonlinear affine systems with an advanced critic learning structure, Quantized optimal output feedback control and optimal triggering signal co‐design for unknown discrete‐time nonlinear systems, Neural optimal tracking control of constrained nonaffine systems with a wastewater treatment application, Neural-network-based discounted optimal control via an integrated value iteration with accuracy guarantee, A signomial programming-based approach for multi-echelon supply chain disruption risk assessment with robust dynamic Bayesian network, Value‐iteration‐based affine nonlinear optimal control involving admissibility discussion, Event‐trigger‐based approximate optimal control of modular robot manipulators using zero‐sum game, Continuous‐time receding‐horizon reinforcement learning and its application to path‐tracking control of autonomous ground vehicles, Discounted near‐optimal regulation of constrained nonlinear systems via generalized value iteration, Robust tracking control of quadrotor via on‐policy adaptive dynamic programming, Optimal output tracking control of linear discrete-time systems with unknown dynamics by adaptive dynamic programming and output feedback, A novel actor-critic-identifier architecture for nonlinear multiagent systems with gradient descent method, Model‐free optimal tracking over finite horizon using adaptive dynamic programming, Multi‐event‐triggered adaptive critic control with guaranteed cost for discrete‐time nonlinear nonzero‐sum games, Optimal trajectory tracking control for a class of nonlinear nonaffine systems via generalized N‐step value gradient learning, Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design, Efficient model-based reinforcement learning for approximate online optimal control, Finite-horizon LQ control for unknown discrete-time linear systems via extremum seeking, Adaptive dynamic programming and optimal control of nonlinear nonaffine systems, Neural-network-based robust optimal control design for a class of uncertain nonlinear systems via adaptive dynamic programming, Generalized value iteration for discounted optimal control with stability analysis, Complete stability analysis of a heuristic approximate dynamic programming control design, Optimal scheduling for reference tracking or state regulation using reinforcement learning, Two-phase iteration for value function approximation and hyperparameter optimization in Gaussian-kernel-based adaptive critic design, A brief review of neural networks based learning and control and their applications for robots, Robust adaptive critic control design with network-based event-triggered formulation, Adaptive T-S fuzzy controller using reinforcement learning based on Lyapunov stability, Decentralized adaptive optimal stabilization of nonlinear systems with matched interconnections, Optimal control of complex systems based on improved dual heuristic dynamic programming algorithm, A model-free distributed cooperative frequency control strategy for MT-HVDC systems using reinforcement learning method, Optimal tracking control based on reinforcement learning value iteration algorithm for time-delayed nonlinear systems with external disturbances and input constraints, Convergence analysis of the deep neural networks based globalized dual heuristic programming, A Q-learning predictive control scheme with guaranteed stability, Impedance model-based optimal regulation on force and position of bimanual robots to hold an object, Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties, Stackelberg games for model-free continuous-time stochastic systems based on adaptive dynamic programming, A novel optimal bipartite consensus control scheme for unknown multi-agent systems via model-free reinforcement learning, Adaptive near-optimal neuro controller for continuous-time nonaffine nonlinear systems with constrained input, Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems, Adaptive optimal tracking controls of unknown multi-input systems based on nonzero-sum game theory, Discrete-time online learning control for a class of unknown nonaffine nonlinear systems using reinforcement learning, Multi-agent discrete-time graphical games and reinforcement learning solutions, Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design, Multi-objective optimal control for a class of nonlinear time-delay systems via adaptive dynamic programming, A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization, Novel iterative neural dynamic programming for data-based approximate optimal control design, On integral generalized policy iteration for continuous-time linear quadratic regulations, Online adaptive optimal control for continuous-time nonlinear systems with completely unknown dynamics, A novel optimal tracking control scheme for a class of discrete-time nonlinear systems using generalised policy iteration adaptive dynamic programming algorithm

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems
• Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence
• An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games
• Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
• Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
• \({\mathcal Q}\)-learning
• On infinite-time nonlinear quadratic optimal control
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• A receding horizon generalization of pointwise min-norm controllers
• Adaptive-critic-based neural networks for aircraft optimal control