Stationary Distributions of Discrete-Time Markov Chains in Random Environment: Exact Computations and Bounds

DOI10.1081/STM-120028393zbMath1037.60087MaRDI QIDQ4451558

Antonis Economou

Publication date: 26 February 2004

Published in: Stochastic Models (Search for Journal in Brave)

zbMATH Keywords

potential; queueing; random environment; stationary distribution; partial balance; discrete time Markov chain; embedded chain; product form distribution; ESTA property

Mathematics Subject Classification ID

60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

60K37: Processes in random environments

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Interconnections of Markov chains and quasi-reversible queuing networks
• Aggregation of Markov chains
• Decomposability in queues with background states
• Spectral expansion solution for a class of Markov models: application and comparison with the matrix-geometric method
• A bivariate random environmental stress model
• Finite birth-and-death models in randomly changing environments
• Optimal control of arrivals to multiserver queues in a random environment
• An Analytic Approach to a General Class of G/G/s Queueing Systems
• The M/M/∞ queue in a random environment
• Connecting reversible Markov processes
• On determining absorption probabilities for Markov chains in random environments
• On the limiting distribution of a supercritical branching process in a random environment
• Connecting internally balanced quasi-reversible Markov processes
• Perturbation analysis of the M/M/1 queue in a markovian environment via the matrix-geometric method
• Markov Chains
• Optimal admission control of markov-modulated batch arrivals to a finite-capacity buffer
• A heterogeneous blocking system in a random environment
• On the transient delays of M/G/1 queues
• On the association of the lifelengths of components subjected to a stochastic environment
• An analytical solution for a tandem queue with blocking