Spectral gap of replica exchange Langevin diffusion on mixture distributions

DOI10.1016/J.SPA.2022.06.006zbMATH Open1492.60218arXiv2006.16193OpenAlexW3038125007MaRDI QIDQ2157333FDOQ2157333

Authors: Jing Dong, Xin Thomson Tong 

Publication date: 27 July 2022

Published in: Stochastic Processes and their Applications (Search for Journal in Brave)

Abstract: Langevin diffusion (LD) is one of the main workhorses for sampling problems. However, its convergence rate can be significantly reduced if the target distribution is a mixture of multiple densities, especially when each component concentrates around a different mode. Replica exchange Langevin diffusion (ReLD) is a sampling method that can circumvent this issue. In particular, ReLD adds another LD sampling a high-temperature version of the target density, and exchange the locations of two LDs according to a Metropolis-Hasting type of law. This approach can be further extended to multiple replica exchange Langevin diffusion (mReLD), where $K$ additional LDs are added to sample distributions at different temperatures and exchanges take place between neighboring-temperature processes. While ReLD and mReLD have been used extensively in statistical physics, molecular dynamics, and other applications, there is little existing analysis on its convergence rate and choices of temperatures. This paper closes these gaps assuming the target distribution is a mixture of log-concave densities. We show ReLD can obtain constant or even better convergence rates even when the density components of the mixture concentrate around isolated modes. We also show using mReLD with $K$ additional LDs can achieve the same result while the exchange frequency only needs to be $(1/K)$-th power of the one in ReLD.

Full work available at URL: https://arxiv.org/abs/2006.16193

Recommendations

• Spectral gap for multi-species exclusion processes
• On spectral gap for multicolored disordered lattice gas of exclusion processes
• An estimate of the spectral gap for zero-range-exclusion dynamics
• The spectral gap of the 2-D stochastic Ising model with mixed boundary conditions
• Approximate spectral gaps for Markov chain mixing times in high dimensions
• Spectral gap of the totally asymmetric exclusion process at arbitrary filling
• Spectral gap for multicolor nearest-neighbor exclusion processes with site disorder
• The spectral gap of the REM under Metropolis dynamics

zbMATH Keywords

mixture modeldiffusion processspectral gap[https://portal.mardi4nfdi.de/w/index.php?title=+Special%3ASearch&search=Markov+chain+Monte+Carlo+Poincar%EF%BF%BD%EF%BF%BD+inequality&go=Go Markov chain Monte Carlo Poincar�� inequality]

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Monte Carlo methods (65C05) Numerical analysis or methods applied to Markov chains (65C40)

Cites Work

• Conditions for rapid mixing of parallel and simulated tempering on multimodal distributions
• Minimising MCMC variance via diffusion limits, with an application to simulated tempering
• Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference
• A note on the Poincaré inequality for convex domains
• Markov chain decomposition for convergence rate analysis
• A simple proof of the Poincaré inequality for a large class of probability measures
• Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
• Partial differential equations and stochastic methods in molecular dynamics
• Title not available (Why is that?)
• On the infinite swapping limit for parallel tempering
• Poincaré and logarithmic Sobolev inequalities by decomposition of the energy landscape
• Likelihood-informed dimension reduction for nonlinear inverse problems
• Mixing times for the swapping algorithm on the Blume-Emery-Griffiths model
• Mathematical analysis of temperature accelerated dynamics
• A large deviations analysis of certain qualitative properties of parallel tempering and infinite swapping algorithms
• MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
• Title not available (Why is that?)
• Weight-preserving simulated tempering
• Localization for MCMC: sampling high-dimensional posterior distributions with local structure
• Infinite Swapping Algorithm for Training Restricted Boltzmann Machines
• Accelerating parallel tempering: quantile tempering algorithm (QuanTA)

Cited In (2)

• On spectral gap for multicolored disordered lattice gas of exclusion processes
• Spectral gap for stochastic energy exchange model with nonuniformly positive rate function

Uses Software

• Gromacs

This page was built for publication: Spectral gap of replica exchange Langevin diffusion on mixture distributions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2157333)