Irreversible samplers from jump and continuous Markov processes
From MaRDI portal
Publication:2329758
Abstract: In this paper, we propose irreversible versions of the Metropolis Hastings (MH) and Metropolis adjusted Langevin algorithm (MALA) with a main focus on the latter. For the former, we show how one can simply switch between different proposal and acceptance distributions upon rejection to obtain an irreversible jump sampler (I-Jump). The resulting algorithm has a simple implementation akin to MH, but with the demonstrated benefits of irreversibility. We then show how the previously proposed MALA method can also be extended to exploit irreversible stochastic dynamics as proposal distributions in the I-Jump sampler. Our experiments explore how irreversibility can increase the efficiency of the samplers in different situations.
Recommendations
- Optimal scaling of the MALA algorithm with irreversible proposals for Gaussian targets
- Markov chain Monte Carlo and irreversibility
- On Irreversible Metropolis Sampling Related to Langevin Dynamics
- Irreversible Monte Carlo algorithms for efficient sampling
- Geometry-informed irreversible perturbations for accelerated convergence of Langevin dynamics
Cites work
- A decomposition of irreversible diffusion processes without detailed balance
- A function space HMC algorithm with second order Langevin diffusion limit
- A piecewise deterministic scaling limit of lifted Metropolis-Hastings in the Curie-Weiss model
- Accelerating diffusions
- Accelerating Gaussian diffusions
- Accelerating reversible Markov chains
- Acceleration of convergence to equilibrium in Markov chains by breaking detailed balance
- Adaptive thermostats for noisy gradient systems
- Analysis of a nonreversible Markov chain sampler.
- Attaining the optimal Gaussian diffusion acceleration
- Bayesian learning for neural networks
- Equation of state calculations by fast computing machines
- Equi-energy sampler with applications in statistical inference and statistical mechanics
- Existence and construction of dynamical potential in nonequilibrium processes without detailed balance
- Fluctuations in Markov processes. Time symmetry and martingale approximation.
- scientific article; zbMATH DE number 3854249 (Why is no real title available?)
- scientific article; zbMATH DE number 5520724 (Why is no real title available?)
- scientific article; zbMATH DE number 194664 (Why is no real title available?)
- scientific article; zbMATH DE number 1911984 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- scientific article; zbMATH DE number 6781368 (Why is no real title available?)
- Hypocoercivity
- Improving the convergence of reversible samplers
- Irreversible Langevin samplers and variance reduction: a large deviations approach
- Irreversible Monte Carlo algorithms for efficient sampling
- Langevin diffusions and Metropolis-Hastings algorithms
- Langevin diffusions and the Metropolis-adjusted Langevin algorithm
- Lifting Markov chains to speed up mixing
- Long-run accuracy of variational integrators in the stochastic context
- Markovian perturbation, response and fluctuation dissipation theorem
- MCMC using Hamiltonian dynamics
- Monte Carlo sampling methods using Markov chains and their applications
- Monte Carlo strategies in scientific computing
- Multivariate output analysis for Markov chain Monte Carlo
- Non-reversible Metropolis-Hastings
- On the notion(s) of duality for Markov processes
- Optimal non-reversible linear drift for the convergence to equilibrium of a diffusion
- Practical Markov Chain Monte Carlo
- Relation of a new interpretation of stochastic differential equations to Itô process
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Semigroups of linear operators and applications to partial differential equations
- Stochastic processes and applications. Diffusion processes, the Fokker-Planck and Langevin equations
- Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models
- Strong consistency of multivariate spectral variance estimators in Markov chain Monte Carlo
- The Bouncy Particle Sampler: A Non-Reversible Rejection-Free Markov Chain Monte Carlo Method
- The zig-zag process and super-efficient sampling for Bayesian analysis of big data
- Thermodynamics of the general diffusion process: time-reversibility and entropy production
- Universal ideal behavior and macroscopic work relation of linear irreversible stochastic thermodynamics
- Variance reduction using nonreversible Langevin samplers
Cited in
(13)- Is there an analog of Nesterov acceleration for gradient-based MCMC?
- Geometry-informed irreversible perturbations for accelerated convergence of Langevin dynamics
- Applying kriging proxies for Markov chain Monte Carlo in reservoir simulation
- Optimal scaling of the MALA algorithm with irreversible proposals for Gaussian targets
- On the convergence time of some non-reversible Markov chain Monte Carlo methods
- Irreversible Langevin MCMC on Lie groups
- On Irreversible Metropolis Sampling Related to Langevin Dynamics
- Non-reversible guided Metropolis kernel
- Hamiltonian-Assisted Metropolis Sampling
- Efficient Bayesian Computation for Low-Photon Imaging Problems
- Irreversible Monte Carlo algorithms for efficient sampling
- Consistent multiscale modelling of movement and habitat selection
- Preconditioned discrete-HAMS: a second-order irreversible discrete sampler
This page was built for publication: Irreversible samplers from jump and continuous Markov processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2329758)
