Q-learning for continuous-time linear systems: A model-free infinite horizon optimal control approach
DOI10.1016/J.SYSCONLE.2016.12.003zbMATH Open1356.93044OpenAlexW2564717627MaRDI QIDQ511735FDOQ511735
Authors: Kyriakos G. Vamvoudakis
Publication date: 22 February 2017
Published in: Systems \& Control Letters (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1016/j.sysconle.2016.12.003
Recommendations
- Integral \(Q\)-learning and explorized policy iteration for adaptive optimal control of continuous-time linear systems
- Reinforcement \(Q\)-learning for optimal tracking control of linear discrete-time systems with unknown dynamics
- Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning
- Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
- Reinforcement learning for adaptive optimal control of continuous-time linear periodic systems
Adaptive control/observation systems (93C40) Control/observation systems with incomplete information (93C41) Discrete-time control/observation systems (93C55)
Cites Work
- \({\mathcal Q}\)-learning
- Title not available (Why is that?)
- Title not available (Why is that?)
- Approximate Dynamic Programming
- Optimal adaptive control and differential games by reinforcement learning principles
- Linear least-squares algorithms for temporal difference learning
- Adaptive Control Tutorial
- Adaptive optimal control for continuous-time linear systems based on policy iteration
- Asynchronous stochastic approximation and Q-learning
- Stochastic approximation with two time scales
- Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics
- Stochastic optimal control of unknown linear networked control system in the presence of random delays and packet losses
- Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers
- Reinforcement \(Q\)-learning for optimal tracking control of linear discrete-time systems with unknown dynamics
- Model-free \(Q\)-learning designs for linear discrete-time zero-sum games with application to \(H^\infty\) control
- Integral \(Q\)-learning and explorized policy iteration for adaptive optimal control of continuous-time linear systems
- Error bounds for constant step-size \(Q\)-learning
- Avoidance of traps in stochastic approximation
Cited In (53)
- Finite-horizon near optimal adaptive control of uncertain linear discrete-time systems
- Finite-horizon optimal control of discrete-time linear systems with completely unknown dynamics using Q-learning
- Homotopic policy iteration-based learning design for unknown linear continuous-time systems
- Deep Q‐learning: A robust control approach
- Self-improving Q-learning based controller for a class of dynamical processes
- Controlled interacting particle algorithms for simulation-based reinforcement learning
- A Q-learning predictive control scheme with guaranteed stability
- Adaptive reinforcement learning in control design for cooperating manipulator systems
- Data-driven approximate Q-learning stabilization with optimality error bound analysis
- On the effect of clock offsets and quantization on learning-based adversarial games
- Model-based and model-free designs for an extended continuous-time LQR with exogenous inputs
- Convergence of a Q-learning variant for continuous states and actions
- Finite-horizon and infinite-horizon linear quadratic optimal control problems: a data-driven Euler scheme
- Data-driven direct adaptive risk-sensitive control of stochastic systems
- Explainable data-driven Q-learning control for a class of discrete-time linear autonomous systems
- An adaptive dynamic programming-based algorithm for infinite-horizon linear quadratic stochastic optimal control problems
- Convergence results for an averaged LQR problem with applications to reinforcement learning
- Finite-time stochastic linear quadratic optimal control based on \(Q\)-learning
- Reduced-dimensional reinforcement learning control using singular perturbation approximations
- Finite-horizon optimal control for continuous-time uncertain nonlinear systems using reinforcement learning
- Model-free policy iteration approach to NCE-based strategy design for linear quadratic Gaussian games
- LQG online learning
- Model-free \(H_{\infty }\) control design for unknown linear discrete-time systems via Q-learning with LMI
- Non-equilibrium dynamic games and cyber-physical security: a cognitive hierarchy approach
- Modified general policy iteration based adaptive dynamic programming for unknown discrete‐time linear systems
- Integral \(Q\)-learning and explorized policy iteration for adaptive optimal control of continuous-time linear systems
- Reinforcement \(Q\)-learning for optimal tracking control of linear discrete-time systems with unknown dynamics
- A Q-Learning Algorithm for Discrete-Time Linear-Quadratic Control with Random Parameters of Unknown Distribution: Convergence and Stabilization
- Robust optimal control of the multi‐input systems with unknown disturbance based on adaptive integral reinforcement learning Q‐function
- Solution of the linear quadratic regulator problem of black box linear systems using reinforcement learning
- Continuous-time reinforcement learning for robust control under worst-case uncertainty
- Robust output group formation tracking control of heterogeneous multi-agent systems with multiple leaders using reinforcement learning
- Efficient model-based reinforcement learning for approximate online optimal control
- Approximate Q Learning for Controlled Diffusion Processes and Its Near Optimality
- A stabilizing reinforcement learning approach for sampled systems with partially unknown models
- Dynamic intermittent Q-learning-based model-free suboptimal co-design of \(\mathcal{L}_2\)
- Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem
- Minimax Q-learning control for linear systems using the Wasserstein metric
- Bias-policy iteration based adaptive dynamic programming for unknown continuous-time linear systems
- Title not available (Why is that?)
- Combining learning and control in linear systems
- Continuous time q-learning for mean-field control problems
- Discounted linear Q-learning control with novel tracking cost and its stability
- Model-free LQR design by Q-function learning
- Nonlinear control using human behavior learning
- Model-free \(Q\)-learning designs for linear discrete-time zero-sum games with application to \(H^\infty\) control
- Optimal control of port-Hamiltonian systems: a continuous-time learning approach
- Learning-based actuator selection for increased attack resilience of uncertain systems
- Learning-based optimal control of linear time-varying systems over large time intervals
- Q-learning for continuous-time graphical games on large networks with completely unknown linear system dynamics
- Optimal control for unknown mean-field discrete-time system based on Q-learning
- Dissipativity-based verification for autonomous systems in adversarial environments
- Model-free event-triggered control algorithm for continuous-time linear systems with optimal performance
Uses Software
This page was built for publication: Q-learning for continuous-time linear systems: A model-free infinite horizon optimal control approach
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q511735)