Limiting distributions of functionals of Markov chains
Let (\(\Omega\),\({\mathcal F},P)\) be a probability space, (E,\({\mathcal E})\) a measurable space, \(\{X_ n: n\geq 0\}\) be a sequence of (E,\({\mathcal E})\)- valued random variables, S be a complete separable metric space equipped with its Borel field \({\mathcal B}\), and let \({\mathcal M}(S)\) be the space of probability measures on (S,\({\mathcal B})\). Let \(\{Y_ n: n\geq 0\}\) be a sequence of (S,\({\mathcal B})\)-valued random variables such that \(p(Y_ n\in A| \sigma (X_ n))=p_{X_ n}(A)\) where \(p_ x(\cdot)\in {\mathcal M}(S)\) for each \(x\in E\) and \(p_.(A)\) is \({\mathcal E}\)-measurable for each \(A\in {\mathcal B}\). Suppose \(S^*={\mathcal M}(S)\) has the topology of weak convergence and let \({\mathcal B}^*\) and \({\mathcal M}^*\) denote the Borel field of \(S^*\) and the set of probability measures on \((S^*,{\mathcal B}^*)\), respectively. Finally let \(\Gamma_ n\) be the distribution of \(p_{X_ n}(\cdot)\), that is, for \(B\in {\mathcal B}^*\), \(\Gamma_ n(B)=P(p_{X_ n}(\cdot)\in B).\) The authors prove that if \(\Gamma_ n\to \Gamma\) weakly in \({\mathcal M}^*\) then \(\{Y_ n\}\) converges in distribution to the law \(\nu \in S^*\), where \(\nu (A)=\int_{S^*}\mu (A)\Gamma (d\mu)\). Several examples are given. Suppose E is a metric space and \({\mathcal E}\) is its Borel field and that the map \(x\to p_ x\in C(E,S^*)\). If \(X_ n\) converges in distribution to a measure \(\pi\) then \(Y_ n\) converges in distribution to \(\nu\) and \(\nu (A)=\int_{E}p_ x(A)\pi (d\nu)\). This is used to prove the convergence in distribution of the inter-event times of a Poisson process with periodic rate function. A second particular case concerns the case where E is countable and \(P(X_ n\in B)\to 0\) (n\(\to \infty)\) for each finite subset \(B\subset E\).
- scientific article; zbMATH DE number 7300703
- scientific article; zbMATH DE number 3459642
- scientific article; zbMATH DE number 4174030
- scientific article; zbMATH DE number 4096492
- Markovian bounds on functions of finite Markov chains
- The limit theorems for functions of Markov chains in random environments
- scientific article; zbMATH DE number 4129770
- Limiting probabilities in Markov chains
- scientific article; zbMATH DE number 5630644
- scientific article; zbMATH DE number 3145626 (Why is no real title available?)
- scientific article; zbMATH DE number 3223982 (Why is no real title available?)
- scientific article; zbMATH DE number 3245885 (Why is no real title available?)
- scientific article; zbMATH DE number 3274494 (Why is no real title available?)
- scientific article; zbMATH DE number 3337270 (Why is no real title available?)
- State of the Art—A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms
- A continuity property of the convolution
- Stochastic flows on a countable set: Convergence in distribution
- Queues with nonstationary inputs
- Renewal theory for functionals of a Markov chain with compact state space.
- Stable limits for Markov chains via the principle of conditioning
- A topology for limits of Markov chains
- On Markov chains induced by partitioned transition probability matrices
- Limits of sequences of Markov chains
- A variant of the Skorokhod theorem for Markov sequences
- scientific article; zbMATH DE number 6686860 (Why is no real title available?)
- scientific article; zbMATH DE number 4174030 (Why is no real title available?)
- scientific article; zbMATH DE number 3854136 (Why is no real title available?)
- scientific article; zbMATH DE number 4201311 (Why is no real title available?)
- scientific article; zbMATH DE number 5630384 (Why is no real title available?)
- scientific article; zbMATH DE number 3965092 (Why is no real title available?)
- scientific article; zbMATH DE number 4028552 (Why is no real title available?)
- Remarks on a monotone Markov chain
- scientific article; zbMATH DE number 4052728 (Why is no real title available?)
- Linear functionals and Markov chains associated with Dirichlet processes
- scientific article; zbMATH DE number 47264 (Why is no real title available?)
- Quasi-limiting distributions of Markov chains that are skip-free to the left in continuous time
- scientific article; zbMATH DE number 4003190 (Why is no real title available?)
- scientific article; zbMATH DE number 1567896 (Why is no real title available?)
- scientific article; zbMATH DE number 836641 (Why is no real title available?)
- scientific article; zbMATH DE number 7338883 (Why is no real title available?)
- scientific article; zbMATH DE number 7300703 (Why is no real title available?)
- scientific article; zbMATH DE number 5220360 (Why is no real title available?)
- Markov chains and mappings of distributions on compact spaces
- Ergodic properties of Poisson processes with almost periodic intensity
This page was built for publication: Limiting distributions of functionals of Markov chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1056975)