General state space Markov chains and MCMC algorithms

DOI10.1214/154957804100000024zbMath1189.60131arXivmath/0404033OpenAlexW2142623799WikidataQ121690679 ScholiaQ121690679MaRDI QIDQ980730

Jeffrey S. Rosenthal, Gareth O. Roberts

Publication date: 29 June 2010

Published in: Probability Surveys (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/math/0404033

Mathematics Subject Classification ID

Point estimation (62F10) Monte Carlo methods (65C05) Discrete-time Markov processes on general state spaces (60J05) Research exposition (monographs, survey articles) pertaining to probability theory (60-02)

Related Items

Noise contrastive estimation: asymptotic properties, formal comparison with MC-MLE, Which ergodic averages have finite asymptotic variance?, Behavior near the extinction time in self-similar fragmentations. II: Finite dislocation measures., Calibrate, emulate, sample, Geometric ergodicity of Rao and Teh's algorithm for homogeneous Markov jump processes, Bayesian Dirichlet mixture model for multivariate extremes: a re-parametrization, Cauchy Markov random field priors for Bayesian inversion, Markov chain Monte Carlo confidence intervals, Dimension free convergence rates for Gibbs samplers for Bayesian linear mixed models, Derivatives of the stochastic growth rate, Markov random geometric graph, MRGG: a growth model for temporal dynamic networks, Observation-driven models for discrete-valued time series, Central limit theorem and self-normalized Cramér-type moderate deviation for Euler-Maruyama scheme, Exact convergence analysis of the independent Metropolis-Hastings algorithms, A computable bound of the essential spectral radius of finite range metropolis-Hastings kernels, Analysis of the Pólya-gamma block Gibbs sampler for Bayesian logistic linear mixed models, Constrained ensemble Langevin Monte Carlo, A predictive multiphase model of silica aerogels for building envelope insulations, Improving the convergence of reversible samplers, Optimally adaptive Bayesian spectral density estimation for stationary and nonstationary processes, On the convergence rate of the ``out-of-order block Gibbs sampler, Penalised t-walk MCMC, Convergence rates of attractive-repulsive MCMC algorithms, Stability of noisy Metropolis-Hastings, Non-reversible Metropolis-Hastings, Hypothesis testing for Markov chain Monte Carlo, Ergodicity of combocontinuous adaptive MCMC algorithms, Improved Markov chain Monte Carlo method for cryptanalysis substitution-transposition cipher, Multiplicative random walk Metropolis-Hastings on the real line, Multilevel rejection sampling for approximate Bayesian computation, The Pólya-gamma Gibbs sampler for Bayesian logistic regression is uniformly ergodic, Subgeometric ergodicity under random-time state-dependent drift conditions, Geometric ergodicity of the Bayesian Lasso, Limit theorems for some adaptive MCMC algorithms with subgeometric kernels, Curvature, concentration and error estimates for Markov chain Monte Carlo, Some remarks on MCMC estimation of spectra of integral operators, Rigorous confidence bounds for MCMC under a geometric drift condition, On the Bayesian calibration of computer model mixtures through experimental data, and the design of predictive models, Generalization bounds of ERM algorithm with Markov chain samples, Stability of adversarial Markov chains, with an application to adaptive MCMC algorithms, Sequential Monte Carlo simulated annealing, Comment: ``Gibbs sampling, exponential families, and orthogonal polynomials, Markov chain Monte Carlo: can we trust the third significant figure?, Monte Carlo methods for light propagation in biological tissues, Limit theorems for stationary Markov processes with \(L^{2}\)-spectral gap, CLTs and asymptotic variance of time-sampled Markov chains, A simple variance inequality for \(U\)-statistics of a Markov chain with applications, A new proof of convergence of MCMC via the ergodic theorem, Adaptive Gibbs samplers and related MCMC methods, Quantitative bounds for Markov chain convergence: Wasserstein and total variation distances, Exact sampling for intractable probability distributions via a Bernoulli factory, Long range search for maximum likelihood in exponential families, On a Gibbs sampler based random process in Bayesian nonparametrics, Stationarity of generalized autoregressive moving average models, Convergence rate of Markov chain methods for genomic motif discovery, Perturbation theory for Markov chains via Wasserstein distance, Convergence of adaptive and interacting Markov chain Monte Carlo algorithms, Geometric ergodicity of the Gibbs sampler for Bayesian quantile regression, On the stability and ergodicity of adaptive scaling Metropolis algorithms, MEXIT: maximal un-coupling times for stochastic processes, Comparison of asymptotic variances of inhomogeneous Markov chains with application to Markov chain Monte Carlo methods, Convergence rate and concentration inequalities for Gibbs sampling in high dimension, Generalization performance of least-square regularized regression algorithm with Markov chain samples, Convergence of Metropolis-type algorithms for a large canonical ensemble, Geometric ergodicity of random scan Gibbs samplers for hierarchical one-way random effects models, Gaussian-Gamma collaborative filtering: a hierarchical Bayesian model for recommender systems, Adaptive sampling of large deviations, Convergence of contrastive divergence algorithm in exponential family, On the rate of convergence to equilibrium for reflected Brownian motion, Quantitative non-geometric convergence bounds for independence samplers, Multivariate initial sequence estimators in Markov chain Monte Carlo, Robust adaptive Metropolis algorithm with coerced acceptance rate, Accelerating diffusions, Variable transformation to obtain geometric ergodicity in the random-walk Metropolis algorithm, On the central limit theorem for geometrically ergodic Markov chains, Bayesian estimation of the functional spatial lag model, An online algorithm for the risk-aware restless bandit, Harris recurrence of Metropolis-within-Gibbs and trans-dimensional Markov chains, Explicit error bounds for lazy reversible Markov chain Monte Carlo, Improving efficiency of data augmentation algorithms using Peskun's theorem, On the use of stochastic approximation Monte Carlo for Monte Carlo integration, Convergence analysis of the Gibbs sampler for Bayesian general linear mixed models with improper priors, Decrypting classical cipher text using Markov chain Monte Carlo, On the scalability and message count of trickle-based broadcasting schemes, Variance estimation in the central limit theorem for Markov chains, Implicitly adaptive importance sampling, A Metropolis-class sampler for targets with non-convex support, Conditions for rapid mixing of parallel and simulated tempering on multimodal distributions, Riemannian barycentres of Gibbs distributions: new results on concentration and convexity in compact symmetric spaces, Convergence of Markov chain transition probabilities, On the convergence complexity of Gibbs samplers for a family of simple Bayesian random effects models, Block Gibbs samplers for logistic mixed models: convergence properties and a comparison with full Gibbs samplers, Large deviations for the empirical measure of the zig-zag process, Hopping between distant basins, Convergence rate bounds for iterative random functions using one-shot coupling, Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection, Stability of overshoots of zero mean random walks, Vlasov equations on digraph measures, Generalized Markov chain tree theorem and Kemeny's constant for a class of non-Markovian matrices, From Bayesian inference to MCMC and convex optimisation in Hadamard manifolds, Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings, Neuronized Priors for Bayesian Sparse Linear Regression, Shrinkage with shrunken shoulders: Gibbs sampling shrinkage model posteriors with guaranteed convergence rates, A fresh Take on ‘Barker Dynamics’ for MCMC, Lagged couplings diagnose Markov chain Monte Carlo phylogenetic inference, Singular relaxation of a random walk in a box with a Metropolis Monte Carlo dynamics, Multilevel Delayed Acceptance MCMC, Spatial populations with seed-banks in random environment. III: Convergence towards mono-type equilibrium, WPPNets and WPPFlows: The Power of Wasserstein Patch Priors for Superresolution, Finite-sample complexity of sequential Monte Carlo estimators, Chilled sampling for uncertainty quantification: a motivation from a meteorological inverse problem ^*, Explicit bounds for spectral theory of geometrically ergodic Markov kernels and applications, Asymptotics for Strassen's optimal transport problem, Exponential inequalities for unbounded functions of geometrically ergodic Markov chains: applications to quantitative error bounds for regenerative Metropolis algorithms, Automatically tuned general-purpose MCMC via new adaptive diagnostics, A Micro-Macro Markov Chain Monte Carlo Method for Molecular Dynamics using Reaction Coordinate Proposals, On the Markov chain Monte Carlo (MCMC) method, A survey of average contractive iterated function systems, Stochastic Normalizing Flows for Inverse Problems: A Markov Chains Viewpoint, Transport Map Accelerated Markov Chain Monte Carlo, Batch means and spectral variance estimators in Markov chain Monte Carlo, A note on formal constructions of sequential conditional couplings, Unnamed Item, Unnamed Item, Complexity bounds for Markov chain Monte Carlo algorithms via diffusion limits, Importance Sampling in Stochastic Programming: A Markov Chain Monte Carlo Approach, Variance bounding of delayed-acceptance kernels, Hit-and-Run for Numerical Integration, Unnamed Item, Correlation decay for hard spheres via Markov chains, Applicability of Subsampling Bootstrap Methods in Markov Chain Monte Carlo, Nonasymptotic Bounds on the Mean Square Error for MCMC Estimates via Renewal Techniques, The computational asymptotics of Gaussian variational inference and the Laplace approximation, Stochastic simulation of sequential game-theory voting models, Qualitative Robustness in Bayesian Inference, Estimating accuracy of the MCMC variance estimator: asymptotic normality for batch means estimators, Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors, On hitting time, mixing time and geometric interpretations of Metropolis-Hastings reversiblizations, A quantitative McDiarmid's inequality for geometrically ergodic Markov chains, A Gibbs Sampler for a Class of Random Convex Polytopes, Hold-out estimates of prediction models for Markov processes, Path integral Monte Carlo method for the quantum anharmonic oscillator, Bayesian latent variable co-kriging model in remote sensing for quality flagged observations, Efficient Bayesian inference with latent Hamiltonian neural networks in no-U-turn sampling, Advanced Multilevel Monte Carlo Methods, Optimization based methods for partially observed chaotic systems, Orlicz Integrability of Additive Functionals of Harris Ergodic Markov Chains, Optimizing combination therapy in a murine model of HER2+ breast cancer, Geometric Ergodicity for Hamiltonian Monte Carlo on Compact Manifolds, Convergence of Griddy Gibbs sampling and other perturbed Markov chains, Optimal Reaction Coordinates: Variational Characterization and Sparse Computation, On the occupancy problem for a regime-switching model, Variance reduction for Markov chains with application to MCMC, A theoretical comparison of the data augmentation, marginal augmentation and PX-DA algorithms, MEASURING MODEL RISK IN FINANCIAL RISK MANAGEMENT AND PRICING, Concentration inequality for U-statistics of order two for uniformly ergodic Markov chains, Local consistency of Markov chain Monte Carlo methods, A martingale decomposition for quadratic forms of Markov chains (with applications), Nonasymptotic bounds on the estimation error of MCMC algorithms, Empirical Bayes estimation of parameters in Markov transition probability matrix with computational methods, A Generalized Black–Litterman Model, Poisson's equation for discrete-time single-birth processes, On asymptotics for Vaserstein coupling of Markov chains, A central limit theorem for adaptive and interacting Markov chains, A Kushner-Stratonovich Monte Carlo filter applied to nonlinear dynamical system identification, Convergence bound in total variation for an image restoration model, Weak convergence of Metropolis algorithms for non-I.I.D. target distributions, On the limitations of single-step drift and minorization in Markov chain convergence analysis, Unnamed Item, Learning performance of regularized regression with multiscale kernels based on Markov observations, Asymptotic of products of Markov kernels. Application to deterministic and random forward/backward products, A regeneration proof of the central limit theorem for uniformly ergodic Markov chains, Augmented truncation approximations to the solution of Poisson's equation for Markov chains, Ergodicity of Markov Processes via Nonstandard Analysis, Convergence of Conditional Metropolis-Hastings Samplers, Interdisciplinary sojourns, On the geometric ergodicity of Metropolis-Hastings algorithms, A unified approach to coupling SDEs driven by Lévy noise and some applications, Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms, Convergence rates of symmetric scan Gibbs sampler, Hitting time and convergence rate bounds for symmetric Langevin diffusions, Approximation of sojourn-times via maximal couplings: motif frequency distributions, Quantitative bounds of convergence for geometrically ergodic Markov chain in the Wasserstein distance with application to the Metropolis adjusted Langevin algorithm, Error bounds for computing the expectation by Markov chain Monte Carlo, Bayesian computation: a summary of the current state, and samples backwards and forwards, Component-wise Markov chain Monte Carlo: uniform and geometric ergodicity under mixing and composition, Metropolis-Hastings reversiblizations of non-reversible Markov chains, On particle Gibbs sampling, Optimal acceptance rates for Metropolis algorithms: Moving beyond 0.234, Convergence and consistency of ERM algorithm with uniformly ergodic Markov chain samples, Fixed-Delay Events in Generalized Semi-Markov Processes Revisited, Adaptive Component-Wise Multiple-Try Metropolis Sampling, On the rate of convergence for the length of the longest common subsequences in hidden Markov models, An approximation scheme for quasi-stationary distributions of killed diffusions, Estimation of risk contributions with MCMC, Additive Functionals for Discrete-Time Markov Chains with Applications to Birth-Death Processes, On the geometric ergodicity of Hamiltonian Monte Carlo, Rademacher complexity for Markov chains: applications to kernel smoothing and Metropolis-Hastings, On the rate of convergence to equilibrium for two-sided reflected Brownian motion and for the Ornstein-Uhlenbeck process, Stabilizing Invertible Neural Networks Using Mixture Models, A Finite Time Analysis of Temporal Difference Learning with Linear Function Approximation, Stochastic Gradient Markov Chain Monte Carlo, Unnamed Item, Ensemble Kalman Sampler: Mean-field Limit and Convergence Analysis, Computation of Expectations by Markov Chain Monte Carlo Methods, Sequential stratified splitting for efficient Monte Carlo integration, Geometric ergodicity of Gibbs samplers for Bayesian general linear mixed models with proper priors, Approximations of geometrically ergodic reversible markov chains, Bayesian total loss estimation using shared random effects, Searching for targets of nonuniform size using mixing transformations: constructive upper bounds and limit laws, Unnamed Item, Central limit theorems for ergodic continuous-time Markov chains with applications to single birth processes