Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design

DOI10.1016/j.automatica.2014.10.056zbMath1309.93188DBLPjournals/automatica/LuoWHL14arXiv1311.0396OpenAlexW2767784613WikidataQ61891152 ScholiaQ61891152MaRDI QIDQ2342464

Huai-Ning Wu, Biao Luo, Derong Liu, Tingwen Huang

Publication date: 28 April 2015

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1311.0396

zbMATH Keywords

Hamilton-Jacobi-Bellman equationneural networknonlinear optimal controlreinforcement learningoff-policydata-based approximate policy iteration

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20) Nonlinear systems in control theory (93C10) Least squares and related methods for stochastic control systems (93E24) Optimal stochastic control (93E20) Computable structure theory, computable model theory (03C57)

Related Items (38)

Output-feedback adaptive optimal control of interconnected systems based on robust adaptive dynamic programming ⋮ ADP based optimal tracking control for a class of linear discrete-time system with multiple delays ⋮ Approximate guaranteed cost fault-tolerant control of unknown nonlinear systems with time-varying actuator faults ⋮ Efficient model-based reinforcement learning for approximate online optimal control ⋮ Trajectory tracking control for under-actuated hovercraft using differential flatness and reinforcement learning-based active disturbance rejection control ⋮ Reinforcement learning solution for HJB equation arising in constrained optimal control problem ⋮ Approximating Optimal feedback Controllers of Finite Horizon Control Problems Using Hierarchical Tensor Formats ⋮ Dynamic event-triggered controller design for nonlinear systems: reinforcement learning strategy ⋮ Suboptimal reduced control of unknown nonlinear singularly perturbed systems via reinforcement learning ⋮ Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iteration ⋮ Trajectory tracking control based on memory data for robots with imprecise dynamic properties and interference ⋮ Critic‐only online adaptive learning based decentralized control schemes for nonlinear large‐scale systems ⋮ A novel actor-critic-identifier architecture for nonlinear multiagent systems with gradient descent method ⋮ Optimal control of unknown nonlinear system under event‐triggered mechanism and identifier‐critic‐actor architecture ⋮ Event-triggered-based online integral reinforcement learning for optimal control of unknown constrained nonlinear systems ⋮ Model-free policy iteration approach to NCE-based strategy design for linear quadratic Gaussian games ⋮ Adaptive data-driven fault-tolerant control for nonlinear systems: Koopman-based virtual actuator approach ⋮ Off-policy based adaptive dynamic programming method for nonzero-sum games on discrete-time system ⋮ Adaptive optimal formation control for unmanned surface vehicles with guaranteed performance using actor‐critic learning architecture ⋮ Data-based optimal coordination control of continuous-time nonlinear multi-agent systems via adaptive dynamic programming method ⋮ Distributed adaptive dynamic programming for data-driven optimal control ⋮ Optimal and robust control of a class of nonlinear systems using dynamically re-optimised single network adaptive critic design ⋮ Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning ⋮ Barrier Lyapunov functions for Nussbaum gain adaptive control of full state constrained nonlinear systems ⋮ Modified value-function-approximation for synchronous policy iteration with single-critic configuration for nonlinear optimal control ⋮ \(\mathrm{H}_\infty\) control of linear discrete-time systems: off-policy reinforcement learning ⋮ Online H∞ control for completely unknown nonlinear systems via an identifier–critic-based ADP structure ⋮ Optimal adaptive fuzzy FTC design for strict-feedback nonlinear uncertain systems with actuator faults ⋮ Non-zero sum differential graphical game: cluster synchronisation for multi-agents with partially unknown dynamics ⋮ Data-based robust adaptive control for a class of unknown nonlinear constrained-input systems via integral reinforcement learning ⋮ Data-based robust optimal control of continuous-time affine nonlinear systems with matched uncertainties ⋮ A reinforcement learning scheme for the equilibrium of the in-vehicle route choice problem based on congestion game ⋮ Decentralized adaptive optimal stabilization of nonlinear systems with matched interconnections ⋮ Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems ⋮ An improvement of single-network adaptive critic design for nonlinear systems with asymmetry constraints ⋮ Mixed density methods for approximate dynamic programming ⋮ Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design ⋮ Approximative Policy Iteration for Exit Time Feedback Control Problems Driven by Stochastic Differential Equations using Tensor Train Format

Uses Software

• VEGAS

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Neural network approach to continuous-time direct adaptive optimal control for partially unknown nonlinear systems
• Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics
• The control parameterization method for nonlinear optimal control: a survey
• Robust adaptive dynamic programming for linear and nonlinear systems: an overview
• Integral \(Q\)-learning and explorized policy iteration for adaptive optimal control of continuous-time linear systems
• Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
• The method of weighted residuals and variational principles. With application in fluid mechanics, heat and mass transfer
• A new algorithm for adaptive multidimensional integration
• Galerkin approximations of the generalized Hamilton-Jacobi-Bellman equation
• Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design
• Time delayed optimal control problems with multiple characteristic time points: computation and industrial applications
• Optimal control of unknown nonaffine nonlinear discrete-time systems based on adaptive dynamic programming
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• An Approximation Theory of Optimal Control for Trainable Manipulators
• Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers

This page was built for publication: Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design