Bayesian nonparametric analysis of reversible Markov chains

DOI10.1214/13-AOS1102MaRDI QIDQ355117zbMATH OpenFDO

Authors Stefano Favaro, Sergio Bacallado, Lorenzo Trippa

Publication date 24 July 2013

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1306.1318, https://projecteuclid.org/euclid.aos/1369836963

zbMATH Keywords

Bayesian nonparametricsmixtures of Markov chainsmolecular dynamicsreinforced random walksreversibilityspecies samplingtwo-parameter Hoppe urn

Mathematics Subject Classification ID

Sums of independent random variables; random walks (60G50) Bayesian problems; characterization of Bayes procedures (62C10) Markov processes: hypothesis testing (62M02) Inference from stochastic processes (62M99)

Abstract: We introduce a three-parameter random walk with reinforcement, called the $$ scheme, which generalizes the linearly edge reinforced random walk to uncountable spaces. The parameter $$ smoothly tunes the $$ scheme between this edge reinforced random walk and the classical exchangeable two-parameter Hoppe urn scheme, while the parameters $alpha$ and $heta$ modulate how many states are typically visited. Resorting to de Finetti's theorem for Markov chains, we use the $$ scheme to define a nonparametric prior for Bayesian analysis of reversible Markov chains. The prior is applied in Bayesian nonparametric inference for species sampling problems with data generated from a reversible Markov chain with an unknown transition kernel. As a real example, we analyze data from molecular dynamics simulations of protein folding.

Recommendations

• Bayesian analysis for reversible Markov chains
• Bayesian analysis of variable-order, reversible Markov chains
• Bayesian nonparametric estimation for reinforced Markov renewal processes
• Analysis of a nonreversible Markov chain sampler.
• Urn schemes and reinforced random walks.

Cites work

• A Bayesian analysis of some nonparametric problems
• Bayesian analysis for reversible Markov chains
• Bayesian analysis of variable-order, reversible Markov chains
• Bayesian nonparametric analysis of reversible Markov chains
• Bayesian Nonparametric Estimation of the Probability of Discovering New Species
• De Finetti's theorem for Markov chains
• Edge-reinforced random walk on finite graphs
• Exact sampling with coupled Markov chains and applications to statistical mechanics
• Ferguson distributions via Polya urn schemes
• Gibbs Sampling Methods for Stick-Breaking Priors
• Hierarchical Dirichlet Processes
• Hierarchical reinforced urn processes
• How edge-reinforced random walk arises naturally
• scientific article; zbMATH DE number 4161783 (Why is no real title available?)
• scientific article; zbMATH DE number 3669678 (Why is no real title available?)
• scientific article; zbMATH DE number 3443655 (Why is no real title available?)
• scientific article; zbMATH DE number 5021952 (Why is no real title available?)
• Recurrence of edge-reinforced random walk on a two-dimensional graph
• The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator
• W. E. Johnson's sufficientness postulate

Cited in

(14)

• Sufficientness postulates for Gibbs-type priors and hierarchical generalizations
• Approximating predictive probabilities of Gibbs-type priors
• Bayesian analysis for reversible Markov chains
• Bayesian nonparametric analysis of reversible Markov chains
• Bayesian Inference in Hidden Markov Models Through the Reversible Jump Markov Chain Monte Carlo Method
• Probabilistic symmetries and invariant neural networks
• Forward-reverse expectation-maximization algorithm for Markov chains: convergence and numerical analysis
• Bayesian analysis of variable-order, reversible Markov chains
• Bayesian inversion by parallel interacting Markov chains
• Bayesian M-T clustering for reduced parameterisation of Markov chains used for nonlinear adaptive elements
• Posterior representations for Bayesian context trees: sampling, estimation and convergence
• Bayesian nonparametric inference for ``species-sampling problems
• Bayesian nonparametric inference for shared species richness in multiple populations
• A note on nonparametric inference for species variety with Gibbs-type priors

This page was built for publication: Bayesian nonparametric analysis of reversible Markov chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q355117)