Multi-player non-zero-sum games: online adaptive learning solution of coupled Hamilton-Jacobi equations

DOI10.1016/j.automatica.2011.03.005zbMath1237.91015OpenAlexW2019338681MaRDI QIDQ642894

Kyriakos G. Vamvoudakis, Frank L. Lewis

Publication date: 27 October 2011

Published in: Automatica (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.automatica.2011.03.005

zbMATH Keywords

Nash equilibriumpersistence of excitationmulti-player gamesadaptive optimal controlcoupled Riccati equationscoupled Hamilton-Jacobi equations

Mathematics Subject Classification ID

Differential games and control (49N70) (n)-person games, (n>2) (91A06) Rationality and learning in game theory (91A26)

Related Items

Numerical solution of two-point BVPs in infinite-horizon optimal control theory: a combined quasilinearization method with exponential Bernstein functions ⋮ Distributed optimal control for continuous-time nonaffine nonlinear interconnected systems ⋮ Nonzero-sum differential games of continuous-time nonlinear systems with uniformly ultimately \(\varepsilon\)-bounded by adaptive dynamic programming ⋮ Multi-agent differential graphical games: online adaptive learning solution for synchronization with optimality ⋮ Adaptive critic designs for decentralised robust control of nonlinear interconnected systems via event-triggering mechanism ⋮ Discrete-time dynamic graphical games: model-free reinforcement learning solution ⋮ Event-triggered adaptive dynamic programming for discrete-time multi-player games ⋮ Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics ⋮ An iterative \(\varepsilon\)-optimal control scheme for a class of discrete-time nonlinear systems with unfixed initial state ⋮ Differential-game for resource aware approximate optimal control of large-scale nonlinear systems with multiple players ⋮ Robust adaptive dynamic programming for linear and nonlinear systems: an overview ⋮ Learning feedback Nash strategies for nonlinear port-Hamiltonian systems ⋮ Model-free algorithm for consensus of discrete-time multi-agent systems using reinforcement learning method ⋮ Optimal group consensus control for the second‐order agents in the coopetition networks via adaptive dynamic programming and event‐triggered methods ⋮ Off‐policy integral reinforcement learning‐based optimal tracking control for a class of nonzero‐sum game systems with unknown dynamics ⋮ Improved model-free H∞ control for batch processes via off-policy 2D game Q-learning ⋮ Robust optimal tracking control for multiplayer systems by off‐policy Q‐learning approach ⋮ Hamiltonian‐driven adaptive dynamic programming for mixed H₂/H_∞ performance using sum‐of‐squares ⋮ Model-free optimal tracking policies for Markov jump systems by solving non-zero-sum games ⋮ Justification of the geometric solution of a target defense game with faster defenders and a convex target area using the HJI equation ⋮ Event-triggered optimal interaction control of the MRM system under the complex multi-task constraints: design and experiments ⋮ Reinforcement learning and cooperative \(H_\infty\) output regulation of linear continuous-time multi-agent systems ⋮ Optimal couple-group tracking control for the heterogeneous multi-agent systems with cooperative-competitive interactions via reinforcement learning method ⋮ An iterative computational scheme for solving the coupled Hamilton-Jacobi-Isaacs equations in nonzero-sum differential games of affine nonlinear systems ⋮ Command filter and dynamic surface control technology based adaptive optimal control of uncertain nonlinear systems in strict‐feedback form ⋮ Model-based reinforcement learning for approximate optimal regulation ⋮ Non-zero sum Nash Q-learning for unknown deterministic continuous-time linear systems ⋮ Model-free policy iteration approach to NCE-based strategy design for linear quadratic Gaussian games ⋮ An approach to solving optimal control problems of nonlinear systems by introducing detail-reward mechanism in deep reinforcement learning ⋮ Off-policy based adaptive dynamic programming method for nonzero-sum games on discrete-time system ⋮ Reinforcement learning algorithms with function approximation: recent advances and applications ⋮ Event-triggered optimal control for discrete-time multi-player non-zero-sum games using parallel control ⋮ Event‐triggered neural experience replay learning for nonzero‐sum tracking games of unknown continuous‐time nonlinear systems ⋮ Differential dynamic programming for finite‐horizon zero‐sum differential games of nonlinear systems ⋮ Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function ⋮ Optimal design of a driver assistance controller based on surrounding vehicle's social behavior game model ⋮ Output feedback adaptive dynamic programming for linear differential zero-sum games ⋮ Adaptive control and signal processing literature survey (No. 27) ⋮ Optimal consensus control for unknown second-order multi-agent systems: using model-free reinforcement learning method ⋮ Optimal distributed synchronization control for continuous-time heterogeneous multi-agent differential graphical games ⋮ Online reinforcement learning multiplayer non-zero sum games of continuous-time Markov jump linear systems ⋮ Online approximate solution of HJI equation for unknown constrained-input nonlinear continuous-time systems ⋮ Pareto optimality in infinite horizon linear quadratic differential games ⋮ Data-driven optimal tracking control of discrete-time multi-agent systems with two-stage policy iteration algorithm ⋮ An analytical fuzzy-based approach to -gain optimal control of input-affine nonlinear systems using Newton-type algorithm ⋮ Non-zero sum differential graphical game: cluster synchronisation for multi-agents with partially unknown dynamics ⋮ Multiperson zero-sum differential games for a class of uncertain nonlinear systems ⋮ Online solution of nonquadratic two-player zero-sum games arising in theH_∞control of constrained input systems ⋮ Reinforcement learning and non-zero-sum game output regulation for multi-player linear uncertain systems ⋮ Finite-time fuzzy game-based attitude control for on-orbit cooperative transporting ⋮ Optimized control for human-multi-robot collaborative manipulation via multi-player Q-learning ⋮ Output regulation of heterogeneous linear multi-agent systems with differential graphical game ⋮ Hybrid online learning control in networked multiagent systems: A survey ⋮ Off-policy Q-learning: solving Nash equilibrium of multi-player games with network-induced delay and unmeasured state ⋮ Nash equilibrium approximation of some class of stochastic differential games: a combined Chebyshev spectral collocation method with policy iteration ⋮ Q-learning solution for optimal consensus control of discrete-time multiagent systems using reinforcement learning ⋮ Adaptive optimal output regulation of linear discrete-time systems based on event-triggered output-feedback ⋮ Learning-based adaptive optimal output regulation of linear and nonlinear systems: an overview ⋮ Optimal control applications and methods literature survey (No. 27) ⋮ Computationally efficient simultaneous policy update algorithm for nonlinearH_∞state feedback control with Galerkin's method ⋮ Optimal control of a class of nonlinear stochastic systems ⋮ Data-driven control of hydraulic servo actuator based on adaptive dynamic programming ⋮ Reinforcement learning for distributed control and multi-player games ⋮ Mixed density methods for approximate dynamic programming ⋮ A hybrid dynamical systems perspective on reinforcement learning for cyber-physical systems: vistas, open problems, and challenges ⋮ Discrete-time online learning control for a class of unknown nonaffine nonlinear systems using reinforcement learning ⋮ Distributed consensus control for nonlinear multi-agent systems ⋮ Multi-agent discrete-time graphical games and reinforcement learning solutions ⋮ Data-driven adaptive dynamic programming for partially observable nonzero-sum games via Q-learning method

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
• Adaptive optimal control for continuous-time linear systems based on policy iteration
• Matrix Riccati equations in control and systems theory
• Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
• Adaptive Control Tutorial
• A Nash game approach to mixed H/sub 2//H/sub ∞/ control
• Adaptive Control Design and Analysis
• On global existence of solutions to coupled matrix Riccati equations in closed-loop Nash games
• Policy Iterations on the Hamilton–Jacobi–Isaacs Equation for $H_{\infty}$ State Feedback Control With Input Saturation
• Approximate Dynamic Programming
• Introduction to game theory