Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers

DOI10.1109/MCS.2012.2214134zbMath1395.93584MaRDI QIDQ5375810

Frank L. Lewis, Kyriakos G. Vamvoudakis, Draguna Vrabie

Publication date: 14 September 2018

Published in: IEEE Control Systems (Search for Journal in Brave)

Mathematics Subject Classification ID

Optimal feedback synthesis (49N35) Feedback control (93B52) Adaptive control/observation systems (93C40) Stochastic learning and adaptive control (93E35)

Related Items (99)

Online data-enabled predictive control ⋮ Homotopic policy iteration-based learning design for unknown linear continuous-time systems ⋮ Optimal tracking control based on reinforcement learning value iteration algorithm for time-delayed nonlinear systems with external disturbances and input constraints ⋮ Generalized value iteration for discounted optimal control with stability analysis ⋮ Embedded adaptive fuzzy controller based on reinforcement learning for DC motor with flexible shaft ⋮ Output-feedback adaptive optimal control of interconnected systems based on robust adaptive dynamic programming ⋮ Value iteration and adaptive dynamic programming for data-driven adaptive optimal control design ⋮ Performance guaranteed attack reconstruction for cyber-physical systems: a new intermediate estimator-based framework ⋮ Stochastic and adaptive optimal control of uncertain interconnected systems: a data-driven approach ⋮ Self-triggered control of probabilistic Boolean control networks: a reinforcement learning approach ⋮ Optimal scheduling for reference tracking or state regulation using reinforcement learning ⋮ Optimal fault detection design via iterative estimation methods for industrial control systems ⋮ Two-phase iteration for value function approximation and hyperparameter optimization in Gaussian-kernel-based adaptive critic design ⋮ Neuro-optimal tracking control for a class of discrete-time nonlinear systems via generalized value iteration adaptive dynamic programming approach ⋮ A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization ⋮ Online adaptive algorithm for optimal control with integral reinforcement learning ⋮ Stabilizing transmission intervals and delays in nonlinear networked control systems through hybrid-system-with-memory modeling and Lyapunov-Krasovskii arguments ⋮ A new on-line exponential parameter estimator without persistent excitation ⋮ Self-learning robust optimal control for continuous-time nonlinear systems with mismatched disturbances ⋮ On the effect of probing noise in optimal control LQR via Q-learning using adaptive filtering algorithms ⋮ Completely model-free RL-based consensus of continuous-time multi-agent systems ⋮ Model-Free control performance improvement using virtual reference feedback tuning and reinforcement Q-learning ⋮ Temporal logic guided safe model-based reinforcement learning: a hybrid systems approach ⋮ Reinforcement learning for robust stabilization of nonlinear systems with asymmetric saturating actuators ⋮ Adaptive critic optimization to decentralized event‐triggered control of continuous‐time nonlinear interconnected systems ⋮ A brief review of neural networks based learning and control and their applications for robots ⋮ Value‐iteration‐based affine nonlinear optimal control involving admissibility discussion ⋮ optimal control for semi‐Markov jump linear systems via TP‐free temporal difference () learning ⋮ Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iteration ⋮ Event-triggered \(H_\infty\) consensus for uncertain nonlinear systems using integral sliding mode based adaptive dynamic programming ⋮ Event-triggered adaptive dynamic programming for decentralized tracking control of input constrained unknown nonlinear interconnected systems ⋮ Optimal consensus control for double‐integrator multiagent systems with unknown dynamics using adaptive dynamic programming ⋮ Optimal tracking control of mechatronic servo system using integral reinforcement learning ⋮ A data‐based private learning framework for enhanced security against replay attacks in cyber‐physical systems ⋮ Optimal control of a two‐wheeled self‐balancing robot by reinforcement learning ⋮ Integral reinforcement learning‐based approximate minimum time‐energy path planning in an unknown environment ⋮ Nonlinear control using human behavior learning ⋮ On the universal transformation of data-driven models to control systems ⋮ Data-driven optimal tracking control of switched linear systems ⋮ Off‐policy model‐based end‐to‐end safe reinforcement learning ⋮ Deep reinforcement learning in finite-horizon to explore the most probable transition pathway ⋮ Review of works by V. A. Yakubovich's scientific school on artificial intelligence and robotics ⋮ Control policy learning design for vehicle urban positioning via BeiDou navigation ⋮ Off-policy reinforcement learning for tracking control of discrete-time Markov jump linear systems with completely unknown dynamics ⋮ Policy iteration reinforcement learning-based control using a grey wolf optimizer algorithm ⋮ Robust H_∞ tracking of linear <scp>discrete‐time</scp> systems using <scp>Q‐learning</scp> ⋮ Non-zero sum Nash Q-learning for unknown deterministic continuous-time linear systems ⋮ Data-based \(\mathcal{L}_2\) gain optimal control for discrete-time system with unknown dynamics ⋮ \(\mathcal{H}_\infty\) tracking learning control for discrete-time Markov jump systems: a parallel off-policy reinforcement learning ⋮ Reinforcement learning-based control using Q-learning and gravitational search algorithm with experimental validation on a nonlinear servo system ⋮ Safe and robust data‐driven cooperative control policy for mixed vehicle platoons ⋮ Optimal trajectory tracking control for a class of nonlinear nonaffine systems via generalized N‐step value gradient learning ⋮ Adaptive optimal formation control for unmanned surface vehicles with guaranteed performance using actor‐critic learning architecture ⋮ Constrained decoupling adaptive dynamic programming for a partially uncontrollable time-delayed model of energy systems ⋮ Solution of the linear quadratic regulator problem of black box linear systems using reinforcement learning ⋮ Event-triggered optimal tracking control of nonlinear systems ⋮ Model-based reinforcement learning for approximate optimal control with temporal logic specifications ⋮ Experience replay–based output feedback Q‐learning scheme for optimal output tracking control of discrete‐time linear systems ⋮ Model-Free Robust Optimal Feedback Mechanisms of Biological Motor Control ⋮ Integral reinforcement learning and experience replay for adaptive optimal control of partially-unknown constrained-input continuous-time systems ⋮ Reinforcement \(Q\)-learning for optimal tracking control of linear discrete-time systems with unknown dynamics ⋮ Two-phase selective decentralization to improve reinforcement learning systems with MDP ⋮ Control of MIMO nonlinear systems: a data-driven model inversion approach ⋮ Optimal and robust control of a class of nonlinear systems using dynamically re-optimised single network adaptive critic design ⋮ Q-learning for continuous-time linear systems: A model-free infinite horizon optimal control approach ⋮ Optimal switching with minimum dwell time constraint ⋮ Optimal distributed synchronization control for continuous-time heterogeneous multi-agent differential graphical games ⋮ Fault detection and isolation of actuator failures in jet engines using adaptive dynamic programming ⋮ Optimal control of complex systems based on improved dual heuristic dynamic programming algorithm ⋮ Reinforcement learning based novel adaptive learning framework for smart grid prediction ⋮ Learning output reference model tracking for higher-order nonlinear systems with unknown dynamics ⋮ Online concurrent reinforcement learning algorithm to solve two‐player zero‐sum games for partially unknown nonlinear continuous‐time systems ⋮ Data-based robust adaptive control for a class of unknown nonlinear constrained-input systems via integral reinforcement learning ⋮ Decentralized adaptive optimal stabilization of nonlinear systems with matched interconnections ⋮ Observer based adaptive dynamic programming for fault tolerant control of a class of nonlinear systems ⋮ An iterative Q-learning based global consensus of discrete-time saturated multi-agent systems ⋮ Hybrid online learning control in networked multiagent systems: A survey ⋮ Output‐feedback H_∞ quadratic tracking control of linear systems using reinforcement learning ⋮ Learning‐based iterative modular adaptive control for nonlinear systems ⋮ Switchings Between Trajectory Tracking and Force Minimization in Human–Robot Collaboration ⋮ Intelligent Human–Robot Interaction Systems Using Reinforcement Learning and Neural Networks ⋮ Approximate optimal adaptive control for weakly coupled nonlinear systems: A neuro-inspired approach ⋮ A solution to the path planning problem via algebraic geometry and reinforcement learning ⋮ Online optimal and adaptive integral tracking control for varying discrete‐time systems using reinforcement learning ⋮ Optimal control of a class of nonlinear stochastic systems ⋮ Adaptive dynamic programming in the Hamiltonian-driven framework ⋮ Reinforcement learning for optimal adaptive control of time delay systems ⋮ Dissipativity-based verification for autonomous systems in adversarial environments ⋮ Reinforcement learning-based model reduction for partial differential equations: application to the Burgers equation ⋮ Computational intelligence in uncertainty quantification for learning control and differential games ⋮ The role of systems biology, neuroscience, and thermodynamics in network control and learning ⋮ Discrete-time online learning control for a class of unknown nonaffine nonlinear systems using reinforcement learning ⋮ Adaptive optimal output tracking of continuous-time systems via output-feedback-based reinforcement learning ⋮ Learning for MPC with stability \& safety guarantees ⋮ Data-based approximate policy iteration for affine nonlinear continuous-time optimal control design ⋮ Safe exploration in model-based reinforcement learning using control barrier functions ⋮ Data-driven adaptive dynamic programming for partially observable nonzero-sum games via Q-learning method ⋮ Continuous-time reinforcement learning for robust control under worst-case uncertainty ⋮ Optimal control for unknown mean-field discrete-time system based on Q-Learning

This page was built for publication: Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers