Renewal theory for functionals of a Markov chain with general state space

From MaRDI portal
Publication:1216112


DOI10.1214/aop/1176996654zbMath0303.60090MaRDI QIDQ1216112

Harry Kesten

Publication date: 1974

Published in: The Annals of Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aop/1176996654


60J05: Discrete-time Markov processes on general state spaces

60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

60K15: Markov renewal processes, semi-Markov processes

60B99: Probability theory on algebraic and topological structures

60F99: Limit theorems in probability theory

60K05: Renewal theory


Related Items

Limit theorems for first-passage times in non–linear markov renewal theory, Asymptotic expansions on moments of the first ladder height in Markov random walks with small drift, Tail of the stationary solution of the stochastic equation \(Y_{n+1}=a_{n} Y_{n}+b_{n}\) with Markovian coefficients, Tail of the stationary solution of the stochastic equation \(Y_{n+1}=a_{n} Y_{n}+b_{n}\) with Markovian coefficients, Quenched limit theorems for nearest neighbour random walks in 1D random environment, Heavy tail phenomenon and convergence to stable laws for iterated Lipschitz maps, On the multidimensional stochastic equation \(Y_{n+1}=A_{n} Y_{n}+B_{n}\), Renewal theory in the analysis of tries and strings, A multi-dimensional renewal theorem for finite Markov chains, Exact asymptotics for the stationary distribution of a Markov chain: a production model, Renewal theorem for a class of stationary sequences, On non-singular renewal kernels with an application to a semigroup of transition kernels, Random difference equations and renewal theory for products of random matrices, Asymptotics of first passage times for random walk in an orthant, A new representation for a renewal-theoretic constant appearing in asymptotic approximations of large deviations, On the Markov renewal theorem, Nonlinear renewal theory for Markov random walks, The random difference equation \(X_ n = A_ n X_{n-1} + B_ n\) in the critical case, SPRT and CUSUM in hidden Markov models, Renewal theory for functionals of a Markov chain with compact state space., Asymptotic operating characteristics of an optimal change point detection in hidden Markov models, Stochastic search in a convex region, Poisson equation, moment inequalities and quick convergence for Markov random walks., The tail of the stationary distribution of a random coefficient \(\text{AR}(q)\) model., Uniform Markov renewal theory and ruin probabilities in Markov random walks., Superposed continuous renewal processes: A Markov renewal approach, Renewal theorem for strongly ergodic Markov chains : application to Lipschitz iterative models, Asymptotics of Markov additive chains on a half-plane: A ratio limit theorem, Upper and lower bounds for the solutions of Markov renewal equations, One-dimensional linear recursions with Markov-dependent coefficients, The key renewal theorem for a transient Markov chain, Tail behaviour of stationary solutions of random difference equations: the case of regular matrices, Asymptotic Hitting Distribution for a Reflected Random Walk in the Positive Quadrant, Large deviations of multiclassM/G/1 queues, Unnamed Item, Unnamed Item, Limit theorems for semi-Markov processes, Nonlinear renewal theory for lattice markov random walk