Handbook of Markov Chain Monte Carlo

DOI10.1201/B10905zbMATH Open1218.65001arXiv1206.1901OpenAlexW621546036MaRDI QIDQ3566744FDOQ3566744

Authors:

Publication date: 9 June 2010

Abstract: Hamiltonian dynamics can be used to produce distant proposals for the Metropolis algorithm, thereby avoiding the slow exploration of the state space that results from the diffusive behaviour of simple random-walk proposals. Though originating in physics, Hamiltonian dynamics can be applied to most problems with continuous state spaces by simply introducing fictitious "momentum" variables. A key to its usefulness is that Hamiltonian dynamics preserves volume, and its trajectories can thus be used to define complex mappings without the need to account for a hard-to-compute Jacobian factor - a property that can be exactly maintained even when the dynamics is approximated by discretizing time. In this review, I discuss theoretical and practical aspects of Hamiltonian Monte Carlo, and present some of its variations, including using windows of states for deciding on acceptance or rejection, computing trajectories using fast approximations, tempering during the course of a trajectory to handle isolated modes, and short-cut methods that prevent useless trajectories from taking much computation time.

Full work available at URL: https://arxiv.org/abs/1206.1901

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Numerical analysis or methods applied to Markov chains (65C40) Collections of articles of miscellaneous specific interest (00B15) Proceedings, conferences, collections, etc. pertaining to numerical analysis (65-06)

Cited In (only showing first 100 items - show all)

• Strong-coupling results for \(\mathcal{N} = 2\) superconformal quivers and holography
• For principled model fitting in mathematical biology
• In mixed company: Bayesian inference for bivariate conditional copula models with discrete and continuous outcomes
• Convergence of conditional Metropolis-Hastings samplers
• Adaptive optimal scaling of Metropolis-Hastings algorithms using the Robbins-Monro process
• Approximation and sampling of multivariate probability distributions in the tensor train decomposition
• Stochastic loss reserving with dependence: a flexible multivariate Tweedie approach
• Uncertainty quantification of density reconstruction using MCMC method in high-energy X-ray radiography
• Gibbs samplers for logistic item response models via the Pólya-gamma distribution: a computationally efficient data-augmentation strategy
• Understanding hormonal crosstalk in \textit{Arabidopsis} root development via emulation and history matching
• Thermodynamic integration and steppingstone sampling methods for estimating Bayes factors: a tutorial
• A transport-based multifidelity preconditioner for Markov chain Monte Carlo
• Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
• A micro-level claim count model with overdispersion and reporting delays
• Computation of epidemic final size distributions
• An Invitation to Sequential Monte Carlo Samplers
• Estimating fibres' material parameter distributions from limited data with the help of Bayesian inference
• Estimating Latent Cell Subpopulations with Bayesian Feature Allocation Models
• Title not available (Why is that?)
• A non-parametric Bayesian approach to decompounding from high frequency data
• Stochastic collocation algorithms using \(l_1\)-minimization for Bayesian solution of inverse problems
• Measuring sample quality with diffusions
• Exact results in a \(\mathcal{N} = 2\) superconformal gauge theory at strong coupling
• Bayesian Abel inversion in quantitative X-ray radiography
• Convergence rates of attractive-repulsive MCMC algorithms
• Bayesian assessment of uncertainty in viscosity closure models for turbidity currents computations
• Post-processing of Markov chain Monte Carlo output in Bayesian latent variable models with application to multidimensional scaling
• Assessment of ordered sequential data assimilation
• Minimising MCMC variance via diffusion limits, with an application to simulated tempering
• Sampling and Statistical Physics via Symmetry
• Reversible jump MCMC for nonparametric drift estimation for diffusion processes
• Bayesian inference in the presence of intractable normalizing functions
• Optimal scaling of MCMC beyond Metropolis
• A generalized parallel replica dynamics
• Spectral likelihood expansions for Bayesian inference
• Likelihood based inference for partially observed renewal processes
• Ergodicity of Markov chain Monte Carlo with reversible proposal
• Multicanonical MCMC for sampling rare events: an illustrative review
• Modeling the complex dynamics and changing correlations of epileptic events
• A Pólya–Gamma sampler for a generalized logistic regression
• Constructing optimal transition matrix for Markov chain Monte Carlo
• On the efficiency of pseudo-marginal random walk Metropolis algorithms
• Adaptive thermostats for noisy gradient systems
• Bayesian Multivariate Mixed Poisson Models with Copula-Based Mixture
• A comparison and catalog of intrinsic tumor growth models
• An improvement of a cryptanalysis algorithm
• Variable transformation to obtain geometric ergodicity in the random-walk Metropolis algorithm
• Stability of adversarial Markov chains, with an application to adaptive MCMC algorithms
• A new probabilistic constraint logic programming language based on a generalised distribution semantics
• MEASURING MODEL RISK IN FINANCIAL RISK MANAGEMENT AND PRICING
• Estimation of time-varying autoregressive stochastic volatility models with stable innovations
• On Irreversible Metropolis Sampling Related to Langevin Dynamics
• Bayesian inference and model comparison for random choice structures
• Practical identifiability of parametrised models: a review of benefits and limitations of various approaches
• Hybrid Monte Carlo on Hilbert spaces
• A generalized multiple-try version of the reversible jump algorithm
• A neural network assisted Metropolis adjusted Langevin algorithm
• Particle MCMC algorithms and architectures for accelerating inference in state-space models
• Bayesian approach to the logistic regression model using Markov chain Monte Carlo methods
• Ergodicity of combocontinuous adaptive MCMC algorithms
• Hilbert space methods for reduced-rank Gaussian process regression
• Practical Hilbert space approximate Bayesian Gaussian processes for probabilistic programming
• Robustness against outliers: A new variance inflated regression model for proportions
• Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
• f-SAEM: a fast stochastic approximation of the EM algorithm for nonlinear mixed effects models
• Hamiltonian-Assisted Metropolis Sampling
• Parameter estimation for reflected Ornstein-Uhlenbeck processes with discrete observations
• Three-point functions in a \(\mathcal{N} = 2\) superconformal gauge theory and their strong-coupling limit
• An Acceleration Strategy for Randomize-Then-Optimize Sampling Via Deep Neural Networks
• The potential and perils of preprocessing: building new foundations
• Nonparametric Bayesian label prediction on a large graph using truncated Laplacian regularization
• Markov-chain Monte-Carlo methods and non-identifiabilities
• Simulating Coulomb and log-gases with hybrid Monte Carlo algorithms
• Reflections on Bayesian inference and Markov chain Monte Carlo
• Handbook of Monte Carlo Methods
• The linear birth-death process: an inferential retrospective
• Information geometry of reversible Markov chains
• The Convergence of Markov Chain Monte Carlo Methods: From the Metropolis Method to Hamiltonian Monte Carlo
• Subsampling MCMC -- an introduction for the survey statistician
• Randomized approaches to accelerate MCMC algorithms for Bayesian inverse problems
• Defect correlators in a \(\mathcal{N} = 2\) SCFT at strong coupling
• Auxiliary Likelihood-Based Approximate Bayesian Computation in State Space Models
• Stochastic modelling of urban structure
• Efficient Markov chain Monte Carlo for combined subset simulation and nonlinear finite element analysis
• Comparing two populations using Bayesian Fourier series density estimation
• Analysis of Langevin Monte Carlo via convex optimization
• Adaptive step size selection for Hessian-based manifold Langevin samplers
• Simultaneous adjustment of bias and coverage probabilities for confidence intervals
• Comparison of hit-and-run, slice sampler and random walk Metropolis
• Probabilistic approach to limited-data computed tomography reconstruction
• Efficiency of delayed-acceptance random walk metropolis algorithms
• Bayesian inference and uncertainty quantification for medical image reconstruction with Poisson data
• A transdimensional approximate Bayesian computation using the pseudo-marginal approach for model choice
• Adaptive Metropolis algorithm using variational Bayesian adaptive Kalman filter
• RMCMC: a system for updating Bayesian models
• Boolean Kalman filter and smoother under model uncertainty
• The joint projected normal and skew-normal: a distribution for poly-cylindrical data
• Selection of vine copulas
• Combining noisy well data and expert knowledge in a Bayesian calibration of a flow model under uncertainties: an application to solute transport in the Ticino basin
• An approximate likelihood perspective on ABC methods

This page was built for publication: Handbook of Markov Chain Monte Carlo

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3566744)