Generalized parallel tempering on Bayesian inverse problems
From MaRDI portal
Abstract: In the current work we present two generalizations of the Parallel Tempering algorithm, inspired by the so-called continuous-time Infinite Swapping algorithm. Such a method, found its origins in the molecular dynamics community, and can be understood as the limit case of the continuous-time Parallel Tempering algorithm, where the (random) time between swaps of states between two parallel chains goes to zero. Thus, swapping states between chains occurs continuously. In the current work, we extend this idea to the context of time-discrete Markov chains and present two Markov chain Monte Carlo algorithms that follow the same paradigm as the continuous-time infinite swapping procedure. We analyze the convergence properties of such discrete-time algorithms in terms of their spectral gap, and implement them to sample from different target distributions. Numerical results show that the proposed methods significantly improve over more traditional sampling algorithms such as Random Walk Metropolis and (traditional) Parallel Tempering.
Recommendations
- Methodological and computational aspects of parallel tempering methods in the infinite swapping limit
- Accelerating parallel tempering: quantile tempering algorithm (QuanTA)
- Generalized parallel sampling
- State-dependent swap strategies and automatic reduction of number of temperatures in adaptive parallel tempering algorithm
- On the infinite swapping limit for parallel tempering
Cites work
- scientific article; zbMATH DE number 1416652 (Why is no real title available?)
- A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
- An adaptive Metropolis algorithm
- Analysis of the ensemble Kalman filter for inverse problems
- Automated solution of differential equations by the finite element method. The FEniCS book
- Bayesian Parameter Identification in Cahn--Hilliard Models for Biological Growth
- Conditions for rapid mixing of parallel and simulated tempering on multimodal distributions
- Dimension-independent likelihood-informed MCMC
- Equation of state calculations by fast computing machines
- Explicit error bounds for Markov chain Monte Carlo
- FEM-based discretization-invariant MCMC methods for PDE-constrained Bayesian inverse problems
- Geometric MCMC for infinite-dimensional inverse problems
- Handbook of Markov Chain Monte Carlo
- MCMC methods for functions: modifying old algorithms to make them faster
- Markov chain decomposition for convergence rate analysis
- Markov chains and stochastic stability
- Monte Carlo sampling methods using Markov chains and their applications
- Multilevel sequential Monte Carlo for Bayesian inverse problems
- Numerical models for differential problems. Translated by Silvia Quarteroni.
- On the convergence of adaptive sequential Monte Carlo methods
- On the infinite swapping limit for parallel tempering
- On the well-posedness of Bayesian inverse problems
- Rates of convergence for everywhere-positive Markov chains
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- Sequential Monte Carlo methods for high-dimensional inverse problems: a case study for the Navier-Stokes equations
- Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
- State-dependent swap strategies and automatic reduction of number of temperatures in adaptive parallel tempering algorithm
- Stochastic simulation: Algorithms and analysis
- The pseudo-marginal approach for efficient Monte Carlo computations
- WASSERSTEIN METRIC-DRIVEN BAYESIAN INVERSION WITH APPLICATIONS TO SIGNAL PROCESSING
- hIPPYlib
Cited in
(19)- Projective Integral Updates for High-Dimensional Variational Inference
- Adaptive tempered reversible jump algorithm for Bayesian curve fitting
- Methodological and computational aspects of parallel tempering methods in the infinite swapping limit
- Bayesian inversion by parallel interacting Markov chains
- Analysis of stochastic gradient descent in continuous time
- Non-Reversible Parallel Tempering: A Scalable Highly Parallel MCMC Scheme
- Less interaction with forward models in Langevin dynamics: enrichment and homotopy
- Parallel tempering for dynamic generalized linear models
- Accelerating parallel tempering: quantile tempering algorithm (QuanTA)
- Weighted particle tempering
- Consistency of Bayesian inference with Gaussian process priors for a parabolic inverse problem
- A large deviations analysis of certain qualitative properties of parallel tempering and infinite swapping algorithms
- Goal-oriented Bayesian optimal experimental design for nonlinear models using Markov chain Monte Carlo
- Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
- Anytime parallel tempering
- Adaptive reduced tempering for Bayesian inverse problems and rare event simulation
- State-dependent swap strategies and automatic reduction of number of temperatures in adaptive parallel tempering algorithm
- Tensor train based sampling algorithms for approximating regularized Wasserstein proximal operators
- Temporal Parallelization of Bayesian Smoothers
This page was built for publication: Generalized parallel tempering on Bayesian inverse problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2058888)
