Spectral gap of replica exchange Langevin diffusion on mixture distributions

DOI10.1016/J.SPA.2022.06.006MaRDI QIDQ2157333zbMATH OpenOpenAlexFDO

Authors Jing Dong, Xin Thomson Tong

Publication date 27 July 2022

Published in Stochastic Processes and their Applications (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2006.16193

zbMATH Keywords

mixture modeldiffusion processspectral gapMarkov chain Monte Carlo Poincaré inequality

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Monte Carlo methods (65C05) Numerical analysis or methods applied to Markov chains (65C40)

Abstract: Langevin diffusion (LD) is one of the main workhorses for sampling problems. However, its convergence rate can be significantly reduced if the target distribution is a mixture of multiple densities, especially when each component concentrates around a different mode. Replica exchange Langevin diffusion (ReLD) is a sampling method that can circumvent this issue. In particular, ReLD adds another LD sampling a high-temperature version of the target density, and exchange the locations of two LDs according to a Metropolis-Hasting type of law. This approach can be further extended to multiple replica exchange Langevin diffusion (mReLD), where $K$ additional LDs are added to sample distributions at different temperatures and exchanges take place between neighboring-temperature processes. While ReLD and mReLD have been used extensively in statistical physics, molecular dynamics, and other applications, there is little existing analysis on its convergence rate and choices of temperatures. This paper closes these gaps assuming the target distribution is a mixture of log-concave densities. We show ReLD can obtain constant or even better convergence rates even when the density components of the mixture concentrate around isolated modes. We also show using mReLD with $K$ additional LDs can achieve the same result while the exchange frequency only needs to be $(1/K)$-th power of the one in ReLD.

Recommendations

• Spectral gap for multi-species exclusion processes
• On spectral gap for multicolored disordered lattice gas of exclusion processes
• An estimate of the spectral gap for zero-range-exclusion dynamics
• The spectral gap of the 2-D stochastic Ising model with mixed boundary conditions
• Approximate spectral gaps for Markov chain mixing times in high dimensions
• Spectral gap of the totally asymmetric exclusion process at arbitrary filling
• Spectral gap for multicolor nearest-neighbor exclusion processes with site disorder
• The spectral gap of the REM under Metropolis dynamics

Cites work

• scientific article; zbMATH DE number 1834589 (Why is no real title available?)
• scientific article; zbMATH DE number 7415116 (Why is no real title available?)
• A large deviations analysis of certain qualitative properties of parallel tempering and infinite swapping algorithms
• A note on the Poincaré inequality for convex domains
• A simple proof of the Poincaré inequality for a large class of probability measures
• Accelerating parallel tempering: quantile tempering algorithm (QuanTA)
• Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference
• Conditions for rapid mixing of parallel and simulated tempering on multimodal distributions
• Infinite Swapping Algorithm for Training Restricted Boltzmann Machines
• Likelihood-informed dimension reduction for nonlinear inverse problems
• Localization for MCMC: sampling high-dimensional posterior distributions with local structure
• MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
• Markov chain decomposition for convergence rate analysis
• Mathematical analysis of temperature accelerated dynamics
• Minimising MCMC variance via diffusion limits, with an application to simulated tempering
• Mixing times for the swapping algorithm on the Blume-Emery-Griffiths model
• On the infinite swapping limit for parallel tempering
• Partial differential equations and stochastic methods in molecular dynamics
• Poincaré and logarithmic Sobolev inequalities by decomposition of the energy landscape
• Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
• Weight-preserving simulated tempering

Cited in

(2)

• On spectral gap for multicolored disordered lattice gas of exclusion processes
• Spectral gap for stochastic energy exchange model with nonuniformly positive rate function

Describes a project that uses

Uses Software

• Gromacs

This page was built for publication: Spectral gap of replica exchange Langevin diffusion on mixture distributions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2157333)