Decentralized reinforcement learning robust optimal tracking control for time varying constrained reconfigurable modular robot based on ACI and Q-function
Decentralized reinforcement learning robust optimal tracking control for time varying constrained reconfigurable modular robot based on ACI and \(Q\)-function
Summary: A novel decentralized reinforcement learning robust optimal tracking control theory for time varying constrained reconfigurable modular robots based on action-critic-identifier (ACI) and state-action value function (\(Q\)-function) has been presented to solve the problem of the continuous time nonlinear optimal control policy for strongly coupled uncertainty robotic system. The dynamics of time varying constrained reconfigurable modular robot is described as a synthesis of interconnected subsystem, and continuous time state equation and \(Q\)-function have been designed in this paper. Combining with ACI and RBF network, the global uncertainty of the subsystem and the HJB (Hamilton-Jacobi-Bellman) equation have been estimated, where critic-NN and action-NN are used to approximate the optimal \(Q\)-function and the optimal control policy, and the identifier is adopted to identify the global uncertainty as well as RBF-NN which is used to update the weights of ACI-NN. On this basis, a novel decentralized robust optimal tracking controller of the subsystem is proposed, so that the subsystem can track the desired trajectory and the tracking error can converge to zero in a finite time. The stability of ACI and the robust optimal tracking controller are confirmed by Lyapunov theory. Finally, comparative simulation examples are presented to illustrate the effectiveness of the proposed ACI and decentralized control theory.
- Decentralized integral sliding mode control for time varying constrained modular and reconfigurable robot based on harmonic drive transmission
- A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems
- Reinforcement learning for adaptive optimal control of unknown continuous-time nonlinear systems with input constraints
- Online optimal and adaptive integral tracking control for varying discrete-time systems using reinforcement learning
- A neural-network-based online optimal control approach for nonlinear robust decentralized stabilization
- \({\mathcal Q}\)-learning
- A calculus for computing Filippov's differential inclusion with application to the variable structure control of robot manipulators
- Asymptotic Tracking for Uncertain Dynamic Systems Via a Multilayer Neural Network Feedforward and RISE Feedback Control Structure
- Deterministic learning based adaptive network control of robot in task space
- Dynamic Approximate Solutions of the HJ Inequality and of the HJB Equation for Input-Affine Nonlinear Systems
- scientific article; zbMATH DE number 1753141 (Why is no real title available?)
- Lebesgue-Sampling-Based Optimal Control Problems With Time Aggregation
This page was built for publication: Decentralized reinforcement learning robust optimal tracking control for time varying constrained reconfigurable modular robot based on ACI and \(Q\)-function
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q473552)
