Semi-Markov processes and their applications

DOI10.1007/BF01097184zbMath0338.60061OpenAlexW2071785075MaRDI QIDQ1231232

S. M. Brodi, Anatoly F. Turbin, Vladimir S. Korolyuk

Publication date: 1976

Published in: Journal of Soviet Mathematics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/bf01097184

Mathematics Subject Classification ID

Markov renewal processes, semi-Markov processes (60K15) Research exposition (monographs, survey articles) pertaining to probability theory (60-02)

Related Items (10)

Limit theorems for an infinite-server queuing system ⋮ Limit theorem for multidimensional renewal equation ⋮ Fuzzy adaptive-event-triggered control for semi-linear parabolic PDE systems with stochastic actuator failures ⋮ Dynamic system with random structure for modeling security and risk management in cyberspace ⋮ Analysis of nonstationary signals and fields with the use of enclosed semi-Markov processes ⋮ Stability and \(H_\infty\) performance of human-in-the-loop control systems through hidden semi-Markov human behavior modeling ⋮ On the construction of component importance measures for semi-Markov systems ⋮ A pure point spectrum of the stochastic one-dimensional Schrödinger operator ⋮ Double merging of the phase space for stochastic differential equations with small additions in Poisson approximation conditions ⋮ Multi-channel queueing networks with input flow controlled by semi-Markov process

Cites Work

• Ergodic theory for discrete semi-Markov chains
• Potentials associated with recurrent Markov renewal processes
• Fluctuations of a renewal-reward process
• On the limiting distributions in Markov renewal processes with finitely many states
• The queue with Poisson input and general service times, treated as a branching process
• Distribution of time above a threshold for semi-Markov jump processes
• Estimation of the transition distributions of a Markov renewal process
• Generalized renewal functions and stationary inventory models
• Iterative solution of the functional equations of undiscounted Markov renewal programming
• On dams with continuous semi-Markovian inputs
• An absorption probability problem
• On one method of proving limit theorems for certain functionals of semi- Markov processes
• Regenerative stochastic processes
• Imbedded Markov Chain Analysis of a Waiting-Line Process in Continuous Time
• On a Sojourn Time Problem in the Theory of Stochastic Processes
• Change of Time Scale For Markov Processes
• Markov Processes with Homogeneous Second Component. I
• On the superposition of m-dimensional point processes
• Imbedded Markov chain analysis of single server bulk queues
• Markov-Renewal Programming. I: Formulation, Finite Return Models
• The Busy Period of a Queue with Batch Service
• Limit Theorems for Markov Renewal Processes
• On the rate of convergence of waiting times
• Geometric convergence of semi-Markov transition probabilities
• DECOMPOSITION OF A SEMI‐MARKOV PROCESS UNDER A MARKOVIAN RULE
• Decomposition of a Semi-Markov Process Under a State Dependent Rule
• Time dependence of queues with semi-Markovian services
• Queues with semi-Markovian arrivals
• The Existence and Uniqueness of Stationary Measures for Markov Renewal Processes
• Markov Renewal Programming by Linear Fractional Programming
• A renewal type theorem on continuous-time $(J,\,X)$-processes
• A General Class of Bulk Queues with Poisson Input
• Queues with State-Dependent Stochastic Service Rates
• Two queues in series with a finite, intermediate waitingroom
• Existence of Stationary Optimal Policies for Some Markov Renewal Programs
• SOME JOINT DISTRIBUTIONS FOR MARKOV RENEWAL PROCESSES1
• Ergodic and ratio limit theorems for ?-recurrent semi-Markov processes
• A Random Time Change Relating Semi-Markov and Markov Processes
• Asymptotic values of the first two moments in Markov renewal processes
• The Integral of a Step Function Defined on a Semi-Markov Process
• A limit theorem on $(J,\,X)$-processes
• An improvement of a limit theorem on $(J,\,X)$-processes
• A Priority Rule Based on the Ranking of the Service Times for the M/G/1 Queue
• A renewal theorem on $(J,\,X)$-processes
• A remark concerning a renewal theorem on $(J,\,X)$-processes
• On the Distribution of the Supremum Functional for Semi-Markov Processes with Continuous State Spaces
• Exponential Ergodicity of the $M/G/1$ Queue
• On the moments of Markov renewal processes
• Regular Variation of Markov Renewal Functions
• Rates of convergence in markov renewal processes with auxiliary paths
• On the Matrix Renewal Function for Markov Renewal Processes
• DISTRIBUTION OF THE NUMBER OF MARKOVIAN RENEWALS IN AN ARBITRARY INTERVAL
• Multichain Markov Renewal Programs
• Markov Renewal Processes with Finitely Many States
• Note on Extreme Values, Competing Risks and Semi-Markov Processes
• The single server queue with Poisson input and semi-Markov service times
• Average cost semi-markov decision processes
• Quasi-stationary distributions in semi-Markov processes
• Two servers in series, studied in terms of a Markov renewal branching process
• Markov renewal theory
• Some Results in Markov Renewal Processes
• Quasi-stationary distributions in semi-Markov processes
• Comparison of Semi-Markov and Markov Processes
• Functions of Semi-Markov Processes
• Random Time Transformations of Semi-Markov Processes
• The analysis of queues by state-dependent parameters by Markov renewal processes
• A queueing system with non-recurrent input and batch servicing
• A queue subject to extraneous phase changes
• A single server tandem queue
• Markov Renewal Processes with Auxiliary Paths
• Finite queues in parallel under a generalized channel selection rule
• Bunching in a semi-Markov process
• Maximal Average-Reward Policies for Semi-Markov Decision Processes With Arbitrary State and Action Space
• Markov Renewal Programs with Small Interest Rates
• Markov Renewal Processes: Definitions and Preliminary Properties
• Remark Concerning Two-State Semi-Markov Processes
• Remarks on the paper ‘Regenerative stochastic processes’
• ON SEMI-MARKOV PROCESSES
• Occupation Times for Markov and Semi-Markov Chains
• Generating Functions for Markov Renewal Processes
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item

This page was built for publication: Semi-Markov processes and their applications