Stability of Markov modulated discrete-time dynamic systems.

DOI10.1016/S0005-1098(03)00133-XMaRDI QIDQ1410357zbMATH OpenOpenAlexFDO

Authors Q. Zhang, George Yin

Publication date 14 October 2003

Published in Automatica (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/s0005-1098(03)00133-x

zbMATH Keywords

Difference equationMarkov chainPath excursionRecurrenceSingular perturbationStability

Mathematics Subject Classification ID

Time-scale analysis and singular perturbations in control/observation systems (93C70) Stochastic stability in control theory (93E15)

Recommendations

• scientific article; zbMATH DE number 5575325
• Stability of Discrete-Time Regime-Switching Dynamic Systems with Delays
• Stochastic stability analysis of Markovian jump systems with additive mode-dependent time-varying delays and partially known transition rates
• Exponential stability of Markov switched systems
• A stability and contractiveness analysis of discrete-time Markovian jump linear systems

Cites work

• Aggregation of Variables in Dynamic Systems
• Algorithms for singularly perturbed limiting average Markov control problems
• Applications of Borovkov's Renovation Theory to Non-Stationary Stochastic Recursive Sequences and Their Control
• Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states.
• Asymptotically optimal controls of hybrid linear quadratic regulators in discrete time.
• Composite stabilization of singularly perturbed stochastic hybrid systems
• Continuous-time Markov chains and applications. A singular perturbation approach
• Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control
• Discrete-time singularly perturbed Markov chains: aggregation, occupation measures, and switching diffusion limit
• Feedback control of a class of linear discrete systems with jump parameters and quadratic cost criteria †
• scientific article; zbMATH DE number 3878095 (Why is no real title available?)
• scientific article; zbMATH DE number 3951715 (Why is no real title available?)
• scientific article; zbMATH DE number 3680816 (Why is no real title available?)
• scientific article; zbMATH DE number 3783337 (Why is no real title available?)
• scientific article; zbMATH DE number 193548 (Why is no real title available?)
• scientific article; zbMATH DE number 3246513 (Why is no real title available?)
• Multiple Lyapunov functions and other analysis tools for switched and hybrid systems
• Nearly optimal control of singularly perturbed Markov decision processes in discrete time
• Nearly-optimal asset allocation in hybrid stock investment models.
• On the stability of retrial queues
• Robust jump linear quadratic control: A mode stabilizing solution
• Robustness of exponential stability of stochastic differential delay equations
• Singularly Perturbed Discrete-Time Markov Chains
• Spreading Code Optimization and Adaptation in CDMA Via Discrete Stochastic Approximation
• Stability of hybrid dynamic systems containing singularly perturbed random processes
• Stability of stochastic differential equations with Markovian switching
• Stability theory for hybrid dynamical systems
• Stochastic approximation algorithms for parallel and distributed processing
• Towards a stability theory of general hybrid dynamical systems

Cited in

(5)

• On hybrid control of a class of stochastic non-linear Markovian switching systems
• Minimal Critical Subsystems for Discrete-Time Markov Models
• Stability of Discrete-Time Regime-Switching Dynamic Systems with Delays
• scientific article; zbMATH DE number 5575325 (Why is no real title available?)
• Exponential Stability of Slow--Fast Stochastic Systems with a Small Delay

This page was built for publication: Stability of Markov modulated discrete-time dynamic systems.

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1410357)