On explicit form of the stationary distributions for a class of bounded Markov chains

DOI10.1017/JPR.2015.21zbMATH Open1337.60167OpenAlexW28264730MaRDI QIDQ2804427FDOQ2804427

Authors Shaun McKinlay, K. Borovkov

Publication date 29 April 2016

Published in Journal of Applied Probability (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1412.1278

zbMATH Keywords

ergodicitybeta distributionMarkov chainsstationary distributionrandom searchgive-and-take modelsemidegenerate kernel

Mathematics Subject Classification ID

Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Discrete-time Markov processes on general state spaces (60J05) Fredholm integral equations (45B05)

Abstract: We consider a class of discrete time Markov chains with state space [0,1] and the following dynamics. At each time step, first the direction of the next transition is chosen at random with probability depending on the current location. Then the length of the jump is chosen independently as a random proportion of the distance to the respective end point of the unit interval, the distributions of the proportions being fixed for each of the two directions. Chains of that kind were subjects of a number of studies and are of interest for some applications. Under simple broad conditions, we establish the ergodicity of such Markov chains and then derive closed form expressions for the stationary densities of the chains when the proportions are beta distributed with the first parameter equal to 1. Examples demonstrating the range of stationary distributions for processes described by this model are given, and an application to a robot coverage algorithm is discussed.

Recommendations

• The stationary probability density of a class of bounded Markov processes
• scientific article; zbMATH DE number 1552337
• Random motions, classes of ergodic Markov chains and beta distributions
• A class of Markov chains with beta ergodic distributions
• scientific article; zbMATH DE number 4026482

Cites work

• scientific article; zbMATH DE number 1193442 (Why is no real title available?)
• scientific article; zbMATH DE number 1850763 (Why is no real title available?)
• A Characterisation of Transient Random Walks on Stochastic Matrices with Dirichlet Distributed Limits
• A class of Markov chains with beta ergodic distributions
• Boundary and initial-value methods for solving Fredholm equations with semidegenerate kernels
• Ergodicity of a bounded Markov chain with attractiveness towards the centre
• Estimating unobservable signal by Markovian noise induction: when noise helps in statistics!
• Importance of search-domain reduction in random optimization
• Iterated Random Functions
• On simulation of random vectors by given densities in regions and on their boundaries
• Optimized relative step size random searches
• Random motions, classes of ergodic Markov chains and beta distributions
• Stochastic adaptive search for global optimization.
• Stochastic give-and-take
• The stationary probability density of a class of bounded Markov processes

Cited in

(9)

• A metapopulation model with Markovian landscape dynamics
• The stationary probability density of a class of bounded Markov processes
• On beta distributed limits of iterated linear random functions
• On the asymptotic behavior of the Diaconis-Freedman chain on \([0, 1]\)
• scientific article; zbMATH DE number 3944985 (Why is no real title available?)
• Ergodicity of a bounded Markov chain with attractiveness towards the centre
• A class of Markov chains with beta ergodic distributions
• On the CLT for stationary Markov chains with trivial tail sigma field
• On a class of random walks in simplexes

This page was built for publication: On explicit form of the stationary distributions for a class of bounded Markov chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2804427)