On explicit form of the stationary distributions for a class of bounded Markov chains

DOI10.1017/JPR.2015.21zbMATH Open1337.60167arXiv1412.1278OpenAlexW28264730MaRDI QIDQ2804427FDOQ2804427

Authors: Shaun McKinlay, K. Borovkov 

Publication date: 29 April 2016

Published in: Journal of Applied Probability (Search for Journal in Brave)

Abstract: We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then the length of the jump is chosen independently as a random proportion of the distance to the respective end point of the unit interval, the distributions of the proportions being fixed for each of the two directions. Chains of that kind were subjects of a number of studies and are of interest for some applications. Under simple broad conditions, we establish the ergodicity of such Markov chains and then derive closed form expressions for the stationary densities of the chains when the proportions are beta distributed with the first parameter equal to 1. Examples demonstrating the range of stationary distributions for processes described by this model are given, and an application to a robot coverage algorithm is discussed.

Full work available at URL: https://arxiv.org/abs/1412.1278

Recommendations

• The stationary probability density of a class of bounded Markov processes
• scientific article; zbMATH DE number 1552337
• Random motions, classes of ergodic Markov chains and beta distributions
• A class of Markov chains with beta ergodic distributions
• scientific article; zbMATH DE number 4026482

zbMATH Keywords

ergodicitybeta distributionMarkov chainsstationary distributionrandom searchgive-and-take modelsemidegenerate kernel

Mathematics Subject Classification ID

Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Discrete-time Markov processes on general state spaces (60J05) Fredholm integral equations (45B05)

Cites Work

• Stochastic adaptive search for global optimization.
• Iterated Random Functions
• Title not available (Why is that?)
• On simulation of random vectors by given densities in regions and on their boundaries
• Random motions, classes of ergodic Markov chains and beta distributions
• A class of Markov chains with beta ergodic distributions
• Ergodicity of a bounded Markov chain with attractiveness towards the centre
• Estimating unobservable signal by Markovian noise induction: when noise helps in statistics!
• Title not available (Why is that?)
• Boundary and initial-value methods for solving Fredholm equations with semidegenerate kernels
• Importance of search-domain reduction in random optimization
• The stationary probability density of a class of bounded Markov processes
• Optimized relative step size random searches
• Stochastic give-and-take
• A Characterisation of Transient Random Walks on Stochastic Matrices with Dirichlet Distributed Limits

Cited In (9)

• On the asymptotic behavior of the Diaconis-Freedman chain on \([0, 1]\)
• On the CLT for stationary Markov chains with trivial tail sigma field
• The stationary probability density of a class of bounded Markov processes
• Ergodicity of a bounded Markov chain with attractiveness towards the centre
• A metapopulation model with Markovian landscape dynamics
• A class of Markov chains with beta ergodic distributions
• On a class of random walks in simplexes
• On beta distributed limits of iterated linear random functions
• Title not available (Why is that?)

This page was built for publication: On explicit form of the stationary distributions for a class of bounded Markov chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2804427)