Langevin diffusions and the Metropolis-adjusted Langevin algorithm

DOI10.1016/J.SPL.2014.04.002zbMATH Open1298.60081arXiv1309.2983OpenAlexW2082399300WikidataQ61434487 ScholiaQ61434487MaRDI QIDQ2453987FDOQ2453987

Authors: Yanyan Li 

Publication date: 12 June 2014

Published in: Statistics \& Probability Letters (Search for Journal in Brave)

Abstract: We provide a clarification of the description of Langevin diffusions on Riemannian manifolds and of the measure underlying the invariant density. As a result we propose a new position-dependent Metropolis-adjusted Langevin algorithm (MALA) based upon a Langevin diffusion in $mathbb{R}^d$ which has the required invariant density with respect to Lebesgue measure. We show that our diffusion and the diffusion upon which a previously-proposed position-dependent MALA is based are equivalent in some cases but are distinct in general. A simulation study illustrates the gain in efficiency provided by the new position-dependent MALA.

Full work available at URL: https://arxiv.org/abs/1309.2983

Recommendations

• Smoothed Langevin proposals in Metropolis-Hastings algorithms.
• Langevin-type models. I: Diffusions with given stationary distributions and their discretizations
• Optimal Scaling of Discrete Approximations to Langevin Diffusions
• Higher order Langevin Monte Carlo algorithm
• An adaptive version for the Metropolis adjusted Langevin algorithm with a truncated drift

zbMATH Keywords

Markov chain Monte CarloRiemannian manifoldsdiffusionsMetropolis-adjusted Langevin algorithm

Mathematics Subject Classification ID

Diffusion processes (60J60) Continuous-time Markov processes on general state spaces (60J25)

Cites Work

• Exponential convergence of Langevin distributions and their discrete approximations
• Title not available (Why is that?)
• Parameter Estimation for Differential Equations: a Generalized Smoothing Approach
• Langevin diffusions and Metropolis-Hastings algorithms
• Time-reversible diffusions
• Optimal Scaling of Discrete Approximations to Langevin Diffusions
• Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
• Higher-order implicit strong numerical schemes for stochastic differential equations
• Title not available (Why is that?)
• Stochastic Calculus
• Stochastic differential equations. An introduction with applications.

Cited In (44)

• Stochastic seismic waveform inversion using generative adversarial networks as a geological prior
• The Langevin Equation as a Global Minimization Algorithm
• Langevin diffusions and Metropolis-Hastings algorithms
• Stochastic gradient MCMC for state space models
• Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons
• Adaptive step size selection for Hessian-based manifold Langevin samplers
• Bayesian inference for nonstationary marginal extremes
• Stability of partially implicit Langevin schemes and their MCMC variants
• Optimal volume-corrected Laplace-Metropolis method
• Computational efficiency study of a micro-macro Markov chain Monte Carlo method for molecular dynamics
• NeuralUQ: A Comprehensive Library for Uncertainty Quantification in Neural Differential Equations and Operators
• Measuring sample quality with diffusions
• Gradient-based adaptive importance samplers
• An adaptive Hessian approximated stochastic gradient MCMC method
• Information-geometric Markov chain Monte Carlo methods using diffusions
• Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks
• Metropolis integration schemes for self-adjoint diffusions
• Oracle lower bounds for stochastic gradient sampling algorithms
• Multi-index antithetic stochastic gradient algorithm
• Bayesian computation: a summary of the current state, and samples backwards and forwards
• Exact targeting of Gibbs distributions using velocity-jump processes
• Autoregressive Moving Average Infinite Hidden Markov-Switching Models
• Geometric Integration of Measure-Preserving Flows for Sampling
• Some Remarks on Preconditioning Molecular Dynamics
• Lévy Langevin Monte Carlo
• Flexible covariate representations for extremes
• Hierarchical models: local proposal variances for RWM-within-Gibbs and MALA-within-Gibbs
• Irreversible samplers from jump and continuous Markov processes
• On Irreversible Metropolis Sampling Related to Langevin Dynamics
• Particle Metropolis-adjusted Langevin algorithms
• Nonasymptotic bounds for sampling algorithms without log-concavity
• Convergence of Position-Dependent MALA with Application to Conditional Simulation in GLMMs
• Geometric MCMC for infinite-dimensional inverse problems
• The forward-backward envelope for sampling with the overdamped Langevin algorithm
• Sampling from manifold-restricted distributions using tangent bundle projections
• Langevin diffusion for population based sampling with an application in Bayesian inference for pharmacodynamics
• Geometric adaptive Monte Carlo in random environment
• Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo
• On sampling from a log-concave density using kinetic Langevin diffusions
• Geometry-informed irreversible perturbations for accelerated convergence of Langevin dynamics
• Hierarchical models and tuning of random walk Metropolis algorithms
• Modified Cholesky Riemann manifold Hamiltonian Monte Carlo: exploiting sparsity for fast sampling of high-dimensional targets
• Smoothed Langevin proposals in Metropolis-Hastings algorithms.
• Langevin-type models. I: Diffusions with given stationary distributions and their discretizations

This page was built for publication: Langevin diffusions and the Metropolis-adjusted Langevin algorithm

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2453987)