A function space HMC algorithm with second order Langevin diffusion limit
From MaRDI portal
(Redirected from Publication:5963495)
Abstract: We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned diffusions. Our algorithm is based on two key design principles: (i) algorithms which are well-defined in infinite dimensions result in methods which do not suffer from the curse of dimensionality when they are applied to approximations of the infinite dimensional target measure on ; (ii) non-reversible algorithms can have better mixing properties compared to their reversible counterparts. The method we introduce is based on the hybrid Monte Carlo algorithm, tailored to incorporate these two design principles. The main result of this paper states that the new algorithm, appropriately rescaled, converges weakly to a second order Langevin diffusion on Hilbert space; as a consequence the algorithm explores the approximate target measures on in a number of steps which is independent of . We also present the underlying theory for the limiting non-reversible diffusion on Hilbert space, including characterization of the invariant measure, and we describe numerical simulations demonstrating that the proposed method has favourable mixing properties as an MCMC algorithm.
Recommendations
- Hybrid Monte Carlo on Hilbert spaces
- Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
- Mixing rates for Hamiltonian Monte Carlo algorithms in finite and infinite dimensions
- Diffusion limits of the random walk Metropolis algorithm in high dimensions
- Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
Cites work
- scientific article; zbMATH DE number 702482 (Why is no real title available?)
- A concise course on stochastic partial differential equations
- A patch that imparts unconditional stability to explicit integrators for Langevin-like equations
- Accelerating Gaussian diffusions
- Accelerating diffusions
- Analysis of a nonreversible Markov chain sampler.
- Asymptotic behaviour of a class of stochastic approximation procedures
- Diffusion limits of the random walk Metropolis algorithm in high dimensions
- Hybrid Monte Carlo on Hilbert spaces
- Invariant measure of the stochastic Allen-Cahn equation: the regime of small noise and large system size
- Inverse problems: a Bayesian perspective
- MCMC METHODS FOR DIFFUSION BRIDGES
- MCMC methods for functions: modifying old algorithms to make them faster
- MCMC using Hamiltonian dynamics
- Monte Carlo sampling methods using Markov chains and their applications
- Noisy gradient flow from a random walk in Hilbert space
- Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
- Pathwise accuracy and ergodicity of metropolized integrators for SDEs
- Signal processing problems on function space: Bayesian formulation, stochastic PDEs and effective MCMC methods
Cited in
(33)- Limit theorems for the zig-zag process
- Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators under Mesh Refinement
- High-dimensional MCMC with a standard splitting scheme for the underdamped Langevin diffusion
- Reversibility of elliptical slice sampling revisited
- On the geometric ergodicity of Hamiltonian Monte Carlo
- Continuum limit and preconditioned Langevin sampling of the path integral molecular dynamics
- Probability and moment inequalities for additive functionals of geometrically ergodic Markov chains
- Two-scale coupling for preconditioned Hamiltonian Monte Carlo in infinite dimensions
- Reversible and non-reversible Markov chain Monte Carlo algorithms for reservoir simulation problems
- Non-reversible processes: GENERIC, hypocoercivity and fluctuations
- Exact targeting of Gibbs distributions using velocity-jump processes
- Using perturbed underdamped Langevin dynamics to efficiently sample from probability distributions
- MCMC methods for functions: modifying old algorithms to make them faster
- Modified Hamiltonian Monte Carlo for Bayesian inference
- Two Metropolis--Hastings Algorithms for Posterior Measures with Non-Gaussian Priors in Infinite Dimensions
- Geometric Integration of Measure-Preserving Flows for Sampling
- Is there an analog of Nesterov acceleration for gradient-based MCMC?
- FEM-based discretization-invariant MCMC methods for PDE-constrained Bayesian inverse problems
- MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
- Irreversible samplers from jump and continuous Markov processes
- Diffusion limit for the random walk Metropolis algorithm out of stationarity
- Mixing rates for Hamiltonian Monte Carlo algorithms in finite and infinite dimensions
- On Irreversible Metropolis Sampling Related to Langevin Dynamics
- Peskun-Tierney ordering for Markovian Monte Carlo: beyond the reversible scenario
- A hybrid adaptive MCMC algorithm in function spaces
- Noisy gradient flow from a random walk in Hilbert space
- Proposals which speed up function-space MCMC
- Non-reversible guided Metropolis kernel
- Hamiltonian-Assisted Metropolis Sampling
- Markov chain Monte Carlo and irreversibility
- Advanced Multilevel Monte Carlo Methods
- Optimal scaling of the MALA algorithm with irreversible proposals for Gaussian targets
- Sampling parameters of ordinary differential equations with constrained Langevin dynamics
This page was built for publication: A function space HMC algorithm with second order Langevin diffusion limit
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5963495)
