A function space HMC algorithm with second order Langevin diffusion limit
From MaRDI portal
Publication:5963495
Abstract: We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned diffusions. Our algorithm is based on two key design principles: (i) algorithms which are well-defined in infinite dimensions result in methods which do not suffer from the curse of dimensionality when they are applied to approximations of the infinite dimensional target measure on ; (ii) non-reversible algorithms can have better mixing properties compared to their reversible counterparts. The method we introduce is based on the hybrid Monte Carlo algorithm, tailored to incorporate these two design principles. The main result of this paper states that the new algorithm, appropriately rescaled, converges weakly to a second order Langevin diffusion on Hilbert space; as a consequence the algorithm explores the approximate target measures on in a number of steps which is independent of . We also present the underlying theory for the limiting non-reversible diffusion on Hilbert space, including characterization of the invariant measure, and we describe numerical simulations demonstrating that the proposed method has favourable mixing properties as an MCMC algorithm.
Recommendations
- Hybrid Monte Carlo on Hilbert spaces
- Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
- Mixing rates for Hamiltonian Monte Carlo algorithms in finite and infinite dimensions
- Diffusion limits of the random walk Metropolis algorithm in high dimensions
- Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
Cites work
- scientific article; zbMATH DE number 702482 (Why is no real title available?)
- A concise course on stochastic partial differential equations
- A patch that imparts unconditional stability to explicit integrators for Langevin-like equations
- Accelerating Gaussian diffusions
- Accelerating diffusions
- Analysis of a nonreversible Markov chain sampler.
- Asymptotic behaviour of a class of stochastic approximation procedures
- Diffusion limits of the random walk Metropolis algorithm in high dimensions
- Hybrid Monte Carlo on Hilbert spaces
- Invariant measure of the stochastic Allen-Cahn equation: the regime of small noise and large system size
- Inverse problems: a Bayesian perspective
- MCMC METHODS FOR DIFFUSION BRIDGES
- MCMC methods for functions: modifying old algorithms to make them faster
- MCMC using Hamiltonian dynamics
- Monte Carlo sampling methods using Markov chains and their applications
- Noisy gradient flow from a random walk in Hilbert space
- Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
- Pathwise accuracy and ergodicity of metropolized integrators for SDEs
- Signal processing problems on function space: Bayesian formulation, stochastic PDEs and effective MCMC methods
Cited in
(31)- On the geometric ergodicity of Hamiltonian Monte Carlo
- Continuum limit and preconditioned Langevin sampling of the path integral molecular dynamics
- Reversible and non-reversible Markov chain Monte Carlo algorithms for reservoir simulation problems
- Probability and moment inequalities for additive functionals of geometrically ergodic Markov chains
- Markov chain Monte Carlo and irreversibility
- Is there an analog of Nesterov acceleration for gradient-based MCMC?
- Advanced Multilevel Monte Carlo Methods
- Non-reversible processes: GENERIC, hypocoercivity and fluctuations
- MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
- Peskun-Tierney ordering for Markovian Monte Carlo: beyond the reversible scenario
- Non-reversible guided Metropolis kernel
- Optimal scaling of the MALA algorithm with irreversible proposals for Gaussian targets
- Limit theorems for the zig-zag process
- Proposals which speed up function-space MCMC
- Two-scale coupling for preconditioned Hamiltonian Monte Carlo in infinite dimensions
- Exact targeting of Gibbs distributions using velocity-jump processes
- High-dimensional MCMC with a standard splitting scheme for the underdamped Langevin diffusion
- Irreversible samplers from jump and continuous Markov processes
- Modified Hamiltonian Monte Carlo for Bayesian inference
- On Irreversible Metropolis Sampling Related to Langevin Dynamics
- A hybrid adaptive MCMC algorithm in function spaces
- Diffusion limit for the random walk Metropolis algorithm out of stationarity
- Hamiltonian-Assisted Metropolis Sampling
- Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators under Mesh Refinement
- Noisy gradient flow from a random walk in Hilbert space
- MCMC methods for functions: modifying old algorithms to make them faster
- FEM-based discretization-invariant MCMC methods for PDE-constrained Bayesian inverse problems
- Two Metropolis--Hastings Algorithms for Posterior Measures with Non-Gaussian Priors in Infinite Dimensions
- Using perturbed underdamped Langevin dynamics to efficiently sample from probability distributions
- Mixing rates for Hamiltonian Monte Carlo algorithms in finite and infinite dimensions
- Geometric Integration of Measure-Preserving Flows for Sampling
This page was built for publication: A function space HMC algorithm with second order Langevin diffusion limit
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5963495)
