Predictive control of linear discrete-time Markovian jump systems by learning recurrent patterns
From MaRDI portal
Abstract: Incorporating pattern-learning for prediction (PLP) in many discrete-time or discrete-event systems allows for computation-efficient controller design by memorizing patterns to schedule control policies based on their future occurrences. In this paper, we demonstrate the effect of PLP by designing a controller architecture for a class of linear Markovian jump systems (MJS) where the aforementioned ``patterns correspond to finite-length sequences of modes. In our analysis of recurrent patterns, we use martingale theory to derive closed-form solutions to quantities pertaining to the occurrence of patterns: 1) the expected minimum occurrence time of any pattern from some predefined collection, 2) the probability of a pattern being the first to occur among the collection. Our method is applicable to real-world dynamics because we make two extensions to common assumptions in prior pattern-occurrence literature. First, the distribution of the mode process is unknown, and second, the true realization of the mode process is not observable. As demonstration, we consider fault-tolerant control of a dynamic topology-switching network, and empirically compare PLP to two controllers without PLP: a baseline based on the novel System Level Synthesis (SLS) approach and a topology-robust extension of the SLS baseline. We show that PLP is able to reject disturbances as effectively as the topology-robust controller at reduced computation time and control effort. We discuss several important tradeoffs, such as the size of the pattern collection and the system scale versus the accuracy of the mode predictions, which show how different PLP implementations affect stabilization and runtime performance.
Recommendations
- Stable receding-horizon scenario predictive control for Markov-jump linear systems
- Feedback predictive control based on periodic invariant set for Markov jump systems
- N-step off-line MPC design of nonhomogeneous Markov jump systems: a suboptimal case
- An efficient model predictive control for Markovian jump systems with all unstable modes
- Constrained robust model predicted control of discrete-time Markov jump linear systems
Cites work
- A Detector-Based Approach for the <inline-formula> <tex-math notation="TeX">$H_{2} $</tex-math></inline-formula> Control of Markov Jump Linear Systems With Partial Information
- A generalized path integral control approach to reinforcement learning
- A martingale approach to the study of occurrence of sequence patterns in repeated experiments
- A sufficient condition for simultaneous stabilization
- Active mode observability of switching linear systems
- Actuator fault accommodation strategy for a team of multi-agent systems subject to switching topology
- An improved approach for constrained robust model predictive control
- Distributed Bayesian filtering using logarithmic opinion pool for dynamic sensor networks
- Distributed Target Detection in Sensor Networks Using Scan Statistics
- Gambling Teams and Waiting Times for Patterns in Two-State Markov Chains
- scientific article; zbMATH DE number 1001726 (Why is no real title available?)
- scientific article; zbMATH DE number 1100439 (Why is no real title available?)
- Jump Control of Probability Densities With Applications to Autonomous Vehicle Motion
- Learning hidden Markov models for linear Gaussian systems with applications to event-based state estimation
- Model predictive control: Theory and practice - a survey
- On occurrence of patterns in Markov chains: Method of gambling teams
- On robust stabilization of Markovian jump systems with uncertain switching probabilities
- Phase synchronization control of complex networks of Lagrangian systems on adaptive digraphs
- Receding-horizon estimation for switching discrete-time linear systems
- Repetitive learning control for a class of partially linearizable uncertain nonlinear systems
- Robust one-step receding horizon control of discrete-time Markovian jump uncertain systems
- Robust variable horizon model predictive control for vehicle maneuvering
- Separable and Localized System-Level Synthesis for Large-Scale Systems
- Simultaneous stabilization via static output feedback and state feedback
- Stochastic stability of the discrete-time extended Kalman filter
- The occurrence of sequence patterns in repeated experiments and hitting times in a Markov chain
- Waiting Times for Patterns and a Method of Gambling Teams
Cited in
(3)- scientific article; zbMATH DE number 5150428 (Why is no real title available?)
- Composite sliding mode adaptive tracking control for singularly perturbed semi-Markov jump non-linear systems with fault and disturbances
- Event-triggered based composite observer-oriented quantized truncated predictive tracking control for Markovian jump delay systems
This page was built for publication: Predictive control of linear discrete-time Markovian jump systems by learning recurrent patterns
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6136143)
