A large deviations analysis of certain qualitative properties of parallel tempering and infinite swapping algorithms
From MaRDI portal
(Redirected from Publication:1670372)
Abstract: Parallel tempering, or replica exchange, is a popular method for simulating complex systems. The idea is to run parallel simulations at different temperatures, and at a given swap rate exchange configurations between the parallel simulations. From the perspective of large deviations it is optimal to let the swap rate tend to infinity and it is possible to construct a corresponding simulation scheme, known as infinite swapping. In this paper we propose a novel use of large deviations for empirical measures for a more detailed analysis of the infinite swapping limit in the setting of continuous time jump Markov processes. Using the large deviations rate function and associated stochastic control problems we consider a diagnostic based on temperature assignments, which can be easily computed during a simulation. We show that the convergence of this diagnostic to its a priori known limit is a necessary condition for the convergence of infinite swapping. The rate function is also used to investigate the impact of asymmetries in the underlying potential landscape, and where in the state space poor sampling is most likely to occur.
Recommendations
- On the infinite swapping limit for parallel tempering
- Methodological and computational aspects of parallel tempering methods in the infinite swapping limit
- Analysis and optimization of certain parallel Monte Carlo methods in the low temperature limit
- Ergodicity of the infinite swapping algorithm at low temperature
- Generalized parallel tempering on Bayesian inverse problems
Cites work
- scientific article; zbMATH DE number 1577097 (Why is no real title available?)
- scientific article; zbMATH DE number 3951715 (Why is no real title available?)
- scientific article; zbMATH DE number 739283 (Why is no real title available?)
- scientific article; zbMATH DE number 1153603 (Why is no real title available?)
- scientific article; zbMATH DE number 3281211 (Why is no real title available?)
- A variational representation for certain functionals of Brownian motion
- An Introduction to Markov Processes
- Asymptotic expansions for Markov processes with Lévy generators
- Exit probabilities and optimal stochastic control
- On the infinite swapping limit for parallel tempering
- On the large deviation rate function for the empirical measures of reversible jump Markov processes
- The Large Deviation Principle for a General Class of Queueing Systems I
- Variational representations for continuous time processes
Cited in
(11)- Equi-energy sampling does not converge rapidly on the mean-field Potts model with three colors close to the critical temperature
- Methodological and computational aspects of parallel tempering methods in the infinite swapping limit
- Infinite Swapping Algorithm for Training Restricted Boltzmann Machines
- Analysis and optimization of certain parallel Monte Carlo methods in the low temperature limit
- Large deviation properties of the empirical measure of a metastable small noise diffusion
- Ergodicity of the infinite swapping algorithm at low temperature
- Spectral gap of replica exchange Langevin diffusion on mixture distributions
- State-dependent swap strategies and automatic reduction of number of temperatures in adaptive parallel tempering algorithm
- Large deviations for the empirical measure of the zig-zag process
- On the infinite swapping limit for parallel tempering
- A large deviation principle for the empirical measures of Metropolis-Hastings chains
This page was built for publication: A large deviations analysis of certain qualitative properties of parallel tempering and infinite swapping algorithms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1670372)
