Geometric integrators and the Hamiltonian Monte Carlo method
From MaRDI portal
Publication:5230516
Abstract: This paper surveys in detail the relations between numerical integration and the Hamiltonian (or hybrid) Monte Carlo method (HMC). Since the computational cost of HMC mainly lies in the numerical integrations, these should be performed as efficiently as possible. However, HMC requires methods that have the geometric properties of being volume-preserving and reversible, and this limits the number of integrators that may be used. On the other hand, these geometric properties have important quantitative implications on the integration error, which in turn have an impact on the acceptance rate of the proposal. While at present the velocity Verlet algorithm is the method of choice for good reasons, we argue that Verlet can be improved upon. We also discuss in detail the behavior of HMC as the dimensionality of the target distribution increases.
Recommendations
Cites work
- scientific article; zbMATH DE number 17141 (Why is no real title available?)
- scientific article; zbMATH DE number 46777 (Why is no real title available?)
- scientific article; zbMATH DE number 88931 (Why is no real title available?)
- scientific article; zbMATH DE number 1300852 (Why is no real title available?)
- scientific article; zbMATH DE number 688058 (Why is no real title available?)
- scientific article; zbMATH DE number 702482 (Why is no real title available?)
- scientific article; zbMATH DE number 1031373 (Why is no real title available?)
- scientific article; zbMATH DE number 1069174 (Why is no real title available?)
- scientific article; zbMATH DE number 1082719 (Why is no real title available?)
- scientific article; zbMATH DE number 1124118 (Why is no real title available?)
- scientific article; zbMATH DE number 1520578 (Why is no real title available?)
- scientific article; zbMATH DE number 1528424 (Why is no real title available?)
- scientific article; zbMATH DE number 194356 (Why is no real title available?)
- scientific article; zbMATH DE number 2238781 (Why is no real title available?)
- A concise introduction to geometric numerical integration
- A patch that imparts unconditional stability to explicit integrators for Langevin-like equations
- A technique for studying strong and weak local errors of splitting stochastic integrators
- Accurate partial difference methods. I: Linear Cauchy problems
- Adaptive multi-stage integrators for optimal energy conservation in molecular simulations
- An improved acceptance procedure for the hybrid Monte Carlo algorithm
- An introduction to MCMC for machine learning
- Analysis of a nonreversible Markov chain sampler.
- Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference
- Computational Biology: Toward Deciphering Gene Regulatory Information in Mammalian Genomes
- Computational discovery of gene regulatory binding motifs: a Bayesian perspective
- Cost of the generalised hybrid Monte Carlo algorithm for free field theory
- Coupling and convergence for Hamiltonian Monte Carlo
- Couplings and quantitative contraction rates for Langevin dynamics
- Delayed rejection in reversible jump Metropolis-Hastings.
- Equation of state calculations by fast computing machines
- Equi-energy sampler with applications in statistical inference and statistical mechanics
- Error Growth in the Numerical Integration of Periodic Orbits, with Application to Hamiltonian and Reversible Systems
- Error analysis of the transport properties of metropolized schemes
- Error growth in the numerical integration of periodic orbits by multistep methods, with application to reversible systems
- Exponential convergence of Langevin distributions and their discrete approximations
- Extra chance generalized hybrid Monte Carlo
- Free energy computations. A mathematical perspective
- GSHMC: An efficient method for molecular simulation
- Geometric Numerical Integration
- Geometric convergence and central limit theorems for multidimensional Hastings and Metropolis algorithms
- Hybrid Monte Carlo on Hilbert spaces
- Instabilities and inaccuracies in the integration of highly oscillatory problems
- Introduction to uncertainty quantification
- Invariant measures of stochastic partial differential equations and conditioned diffusions
- Inverse problems: a Bayesian perspective
- MCMC METHODS FOR DIFFUSION BRIDGES
- MCMC using Hamiltonian dynamics
- Markov chain Monte Carlo and numerical differential equations
- Markov chains for exploring posterior distributions. (With discussion)
- Metropolis integration schemes for self-adjoint diffusions
- Molecular modeling and simulation. An interdisciplinary guide
- Monte Carlo sampling methods using Markov chains and their applications
- Monte Carlo strategies in scientific computing.
- Nonasymptotic mixing of the MALA algorithm
- Numerical Methods for Ordinary Differential Equations
- Numerical Methods for Ordinary Differential Equations
- Numerical integrators for the hybrid Monte Carlo method
- On Metropolis-Hastings algorithms with delayed rejection
- On the Numerical Integration of Ordinary Differential Equations by Symmetric Composition Methods
- On the Scope of the Method of Modified Equations
- On the application of improved symplectic integrators in Hamiltonian Monte Carlo
- Optimal Scaling of Discrete Approximations to Langevin Diffusions
- Optimal tuning of the hybrid Monte Carlo algorithm
- Order conditions for numerical integrators obtained by composing simpler integrators
- Palindromic 3-stage splitting integrators, a roadmap
- Pathwise accuracy and ergodicity of metropolized integrators for SDEs
- Pattern recognition and machine learning.
- Practical construction of modified Hamiltonians
- Randomized Hamiltonian Monte Carlo
- Real-Parameter Evolutionary Monte Carlo With Applications to Bayesian Mixture Models
- Reflection couplings and contraction rates for diffusions
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Sampling conditioned diffusions
- Sampling-Based Approaches to Calculating Marginal Densities
- Shadow hybrid Monte Carlo: an efficient propagator in phase space of macromolecules
- Simulating Hamiltonian Dynamics
- Slice sampling. (With discussions and rejoinder)
- Solving Ordinary Differential Equations I
- Solving ordinary differential equations. II: Stiff and differential-algebraic problems.
- Statistical mechanics: Algorithms and computations. With CD-ROM.
- Statistical mechanics: theory and molecular simulation.
- Stochastic Equations in Infinite Dimensions
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
- Stochastic simulation: Algorithms and analysis
- Symplectic Geometric Algorithms for Hamiltonian Systems
- Symplectic Runge-Kutta schemes for adjoint equations, automatic differentiation, optimal control, and more
- The BUGS book. A practical introduction to Bayesian analysis
- The Development of Variable-Step Symplectic Integrators, with Application to the Two-Body Problem
- The Markov chain Monte Carlo revolution
- The ensemble Kalman filter for combined state and parameter estimation
- The no-U-turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo
- Theoretical and numerical comparison of some sampling methods for molecular dynamics
- Time-reversal symmetry in dynamical systems: a survey
- Weak convergence and optimal scaling of random walk Metropolis algorithms
- Word series for dynamical systems and their numerical integrators
Cited in
(52)- Adaptive multi-stage integration schemes for Hamiltonian Monte Carlo
- An Hermite-Obreshkov method for 2nd-order linear initial-value problems for ODE. With special attention paid to the Mathieu equation
- On explicit \(L^2\)-convergence rate estimate for piecewise deterministic Markov processes in MCMC algorithms
- On the accept-reject mechanism for Metropolis-Hastings algorithms
- Mixing time guarantees for unadjusted Hamiltonian Monte Carlo
- GPU-accelerated particle methods for evaluation of sparse observations for inverse problems constrained by diffusion PDEs
- Irreducibility and geometric ergodicity of Hamiltonian Monte Carlo
- On the geometric ergodicity of Hamiltonian Monte Carlo
- scientific article; zbMATH DE number 7626757 (Why is no real title available?)
- Continuum limit and preconditioned Langevin sampling of the path integral molecular dynamics
- Improving sampling accuracy of stochastic gradient MCMC methods via non-uniform subsampling of gradients
- A New Optimality Property of Strang’s Splitting
- Data assimilation: the Schrödinger perspective
- Tuning symplectic integrators is easy and worthwhile
- Geometrical Monte Carlo method and its modifications
- Two-scale coupling for preconditioned Hamiltonian Monte Carlo in infinite dimensions
- Multi-stage splitting integrators for sampling with modified Hamiltonian Monte Carlo methods
- Adaptive parameters tuning based on energy-preserving splitting integration for Hamiltonian Monte Carlo method
- Computing quantum dynamics in the semiclassical regime
- Coupling and convergence for Hamiltonian Monte Carlo
- Mixing of Metropolis-adjusted Markov chains via couplings: the high acceptance regime
- Splitting methods for differential equations
- Choice of integrator in the hybrid Monte Carlo algorithm
- Truncated log-concave sampling for convex bodies with reflective Hamiltonian Monte Carlo
- Learning variational autoencoders via MCMC speed measures
- Log-density gradient covariance and automatic metric tensors for Riemann manifold Monte Carlo methods
- On the application of improved symplectic integrators in Hamiltonian Monte Carlo
- Adaptive tuning of Hamiltonian Monte Carlo within sequential Monte Carlo
- Geometric Integration of Measure-Preserving Flows for Sampling
- Randomized Hamiltonian Monte Carlo
- B-methods for the numerical solution of evolution problems with blow-up solutions. II: Splitting methods
- Uncertainty quantification for random Hamiltonian systems by using polynomial expansions and geometric integrators
- Convergence of unadjusted Hamiltonian Monte Carlo for mean-field models
- Mixing rates for Hamiltonian Monte Carlo algorithms in finite and infinite dimensions
- A Bayesian Approach to Estimating Background Flows from a Passive Scalar
- Numerical integrators for the hybrid Monte Carlo method
- Tuning diagonal scale matrices for HMC
- Kinetic energy choice in Hamiltonian/hybrid Monte Carlo
- Geometric adaptive Monte Carlo in random environment
- Connecting the Dots: Numerical Randomized Hamiltonian Monte Carlo with State-Dependent Event Rates
- Motion equations in a Kerr–Newman–de Sitter spacetime: some methods of integration and application to black holes shadowing in Scilab
- Applying kriging proxies for Markov chain Monte Carlo in reservoir simulation
- Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo
- Geometric numerical integration. Abstracts from the workshop held March 28 -- April 3, 2021 (hybrid meeting)
- Cores for piecewise-deterministic Markov processes used in Markov chain Monte Carlo
- Geodesic Lagrangian Monte Carlo over the space of positive definite matrices: with application to Bayesian spectral density estimation
- MCMC using Hamiltonian dynamics
- Symmetrically processed splitting integrators for enhanced Hamiltonian Monte Carlo sampling
- Split Hamiltonian Monte Carlo revisited
- Sampling algorithms in statistical physics: a guide for statistics and machine learning
- HMC: reducing the number of rejections by not using leapfrog and some results on the acceptance rate
- Asymptotic bias of inexact Markov chain Monte Carlo methods in high dimension
This page was built for publication: Geometric integrators and the Hamiltonian Monte Carlo method
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5230516)
