Diffusion limits of the random walk Metropolis algorithm in high dimensions

DOI10.1214/10-AAP754zbMath1254.60081arXiv1003.4306OpenAlexW2127836946MaRDI QIDQ433896

Natesh S. Pillai, Andrew M. Stuart, Jonathan C. Mattingly

Publication date: 8 July 2012

Published in: The Annals of Applied Probability (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1003.4306

zbMATH Keywords

Markov chain Monte Carlostochastic partial differential equationsscaling limitsoptimal convergenceconvergence timedifffusion limitrandom walk Metropolis-Hastings

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Central limit and other weak theorems (60F05) Monte Carlo methods (65C05) Discrete-time Markov processes on general state spaces (60J05) Numerical analysis or methods applied to Markov chains (65C40) Stochastic partial differential equations (aspects of stochastic analysis) (60H15)

Related Items (44)

Asymptotic analysis of the random walk metropolis algorithm on ridged densities ⋮ Dimension-independent likelihood-informed MCMC ⋮ Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction ⋮ Unnamed Item ⋮ Hierarchical models: local proposal variances for RWM-within-Gibbs and MALA-within-Gibbs ⋮ A Dirichlet form approach to MCMC optimal scaling ⋮ Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors ⋮ Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions ⋮ Explicit contraction rates for a class of degenerate and infinite-dimensional diffusions ⋮ Spectral gaps and error estimates for infinite-dimensional Metropolis-Hastings with non-Gaussian priors ⋮ Certified Dimension Reduction for Bayesian Updating with the Cross-Entropy Method ⋮ Interacting Langevin Diffusions: Gradient Structure and Ensemble Kalman Sampler ⋮ Optimal scaling of the MALA algorithm with irreversible proposals for Gaussian targets ⋮ Optimal scaling of random-walk Metropolis algorithms on general target distributions ⋮ A hierarchical Bayesian approach for modeling the evolution of the 7-day moving average of the number of deaths by COVID-19 ⋮ Scalable Optimization-Based Sampling on Function Space ⋮ Optimal tuning of the hybrid Monte Carlo algorithm ⋮ A Bayesian Approach to Estimating Background Flows from a Passive Scalar ⋮ Bayesian Inverse Problems with $l_1$ Priors: A Randomize-Then-Optimize Approach ⋮ Multimodal, high-dimensional, model-based, Bayesian inverse problems with applications in biomechanics ⋮ Error bounds for Metropolis-Hastings algorithms applied to perturbations of Gaussian measures in high dimensions ⋮ Optimal scaling for the transient phase of Metropolis Hastings algorithms: the longtime behavior ⋮ Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions ⋮ Noisy gradient flow from a random walk in Hilbert space ⋮ A Hybrid Adaptive MCMC Algorithm in Function Spaces ⋮ An Adaptive Independence Sampler MCMC Algorithm for Bayesian Inferences of Functions ⋮ Bayesian Inference Using Intermediate Distribution Based on Coarse Multiscale Model for Time Fractional Diffusion Equations ⋮ On an adaptive preconditioned Crank-Nicolson MCMC algorithm for infinite dimensional Bayesian inference ⋮ Weak convergence and optimal tuning of the reversible jump algorithm ⋮ Hierarchical models and tuning of random walk Metropolis algorithms ⋮ On the stability of sequential Monte Carlo methods in high dimensions ⋮ Asymptotic variance for random walk Metropolis chains in high dimensions: logarithmic growth via the Poisson equation ⋮ A function space HMC algorithm with second order Langevin diffusion limit ⋮ Scaling analysis of delayed rejection MCMC methods ⋮ MCMC methods for functions: modifying old algorithms to make them faster ⋮ Random walk Metropolis algorithm in high dimension with non-Gaussian target distributions ⋮ Langevin type limiting processes for adaptive MCMC ⋮ Efficiency of delayed-acceptance random walk metropolis algorithms ⋮ Accelerated Dimension-Independent Adaptive Metropolis ⋮ Non-stationary phase of the MALA algorithm ⋮ Randomized Hamiltonian Monte Carlo as scaling limit of the bouncy particle sampler and dimension-free convergence rates ⋮ Diffusion limit for the random walk Metropolis algorithm out of stationarity ⋮ On the empirical efficiency of local MCMC algorithms with pools of proposals ⋮ Optimal scaling for the transient phase of the random walk Metropolis algorithm: the mean-field limit

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Asymptotic behaviour of a class of stochastic approximation procedures
• Weak convergence and optimal scaling of random walk Metropolis algorithms
• Optimal scaling for various Metropolis-Hastings algorithms.
• From Metropolis to diffusions: Gibbs states and optimal scaling.
• Optimal scaling of MaLa for nonlinear regression.
• Stein's method for concentration inequalities
• Optimal scalings for local Metropolis-Hastings chains on nonproduct targets in high dimensions
• Weak convergence of Metropolis algorithms for non-I.I.D. target distributions
• Monte Carlo strategies in scientific computing.
• Analysis of SPDEs arising in path sampling. II: The nonlinear case
• Analysis of SPDEs arising in path sampling. I: The Gaussian case
• Inverse problems: A Bayesian perspective
• Approximation of Bayesian Inverse Problems for PDEs
• MCMC METHODS FOR DIFFUSION BRIDGES
• Pathwise accuracy and ergodicity of metropolized integrators for SDEs
• Optimal Scaling of Discrete Approximations to Langevin Diffusions
• Monte Carlo sampling methods using Markov chains and their applications
• Stochastic Equations in Infinite Dimensions

This page was built for publication: Diffusion limits of the random walk Metropolis algorithm in high dimensions