Handbook of Markov Chain Monte Carlo

DOI10.1201/B10905zbMATH Open1218.65001arXiv1206.1901OpenAlexW621546036MaRDI QIDQ3566744FDOQ3566744

Authors:

Publication date: 9 June 2010

Abstract: Hamiltonian dynamics can be used to produce distant proposals for the Metropolis algorithm, thereby avoiding the slow exploration of the state space that results from the diffusive behaviour of simple random-walk proposals. Though originating in physics, Hamiltonian dynamics can be applied to most problems with continuous state spaces by simply introducing fictitious "momentum" variables. A key to its usefulness is that Hamiltonian dynamics preserves volume, and its trajectories can thus be used to define complex mappings without the need to account for a hard-to-compute Jacobian factor - a property that can be exactly maintained even when the dynamics is approximated by discretizing time. In this review, I discuss theoretical and practical aspects of Hamiltonian Monte Carlo, and present some of its variations, including using windows of states for deciding on acceptance or rejection, computing trajectories using fast approximations, tempering during the course of a trajectory to handle isolated modes, and short-cut methods that prevent useless trajectories from taking much computation time.

Full work available at URL: https://arxiv.org/abs/1206.1901

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Numerical analysis or methods applied to Markov chains (65C40) Collections of articles of miscellaneous specific interest (00B15) Proceedings, conferences, collections, etc. pertaining to numerical analysis (65-06)

Cited In (only showing first 100 items - show all)

• Strong-coupling results for \(\mathcal{N} = 2\) superconformal quivers and holography
• For principled model fitting in mathematical biology
• In mixed company: Bayesian inference for bivariate conditional copula models with discrete and continuous outcomes
• Convergence of conditional Metropolis-Hastings samplers
• Adaptive optimal scaling of Metropolis-Hastings algorithms using the Robbins-Monro process
• Approximation and sampling of multivariate probability distributions in the tensor train decomposition
• Stochastic loss reserving with dependence: a flexible multivariate Tweedie approach
• Uncertainty quantification of density reconstruction using MCMC method in high-energy X-ray radiography
• Gibbs samplers for logistic item response models via the Pólya-gamma distribution: a computationally efficient data-augmentation strategy
• Understanding hormonal crosstalk in \textit{Arabidopsis} root development via emulation and history matching
• Thermodynamic integration and steppingstone sampling methods for estimating Bayes factors: a tutorial
• A transport-based multifidelity preconditioner for Markov chain Monte Carlo
• Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
• A micro-level claim count model with overdispersion and reporting delays
• Computation of epidemic final size distributions
• An Invitation to Sequential Monte Carlo Samplers
• Estimating fibres' material parameter distributions from limited data with the help of Bayesian inference
• Estimating Latent Cell Subpopulations with Bayesian Feature Allocation Models
• Title not available (Why is that?)
• A non-parametric Bayesian approach to decompounding from high frequency data
• Stochastic collocation algorithms using \(l_1\)-minimization for Bayesian solution of inverse problems
• Measuring sample quality with diffusions
• Exact results in a \(\mathcal{N} = 2\) superconformal gauge theory at strong coupling
• Bayesian Abel inversion in quantitative X-ray radiography
• Convergence rates of attractive-repulsive MCMC algorithms
• Bayesian assessment of uncertainty in viscosity closure models for turbidity currents computations
• Post-processing of Markov chain Monte Carlo output in Bayesian latent variable models with application to multidimensional scaling
• Assessment of ordered sequential data assimilation
• Minimising MCMC variance via diffusion limits, with an application to simulated tempering
• Sampling and Statistical Physics via Symmetry
• Reversible jump MCMC for nonparametric drift estimation for diffusion processes
• Bayesian inference in the presence of intractable normalizing functions
• Optimal scaling of MCMC beyond Metropolis
• A generalized parallel replica dynamics
• Spectral likelihood expansions for Bayesian inference
• Likelihood based inference for partially observed renewal processes
• Ergodicity of Markov chain Monte Carlo with reversible proposal
• Multicanonical MCMC for sampling rare events: an illustrative review
• Modeling the complex dynamics and changing correlations of epileptic events
• A Pólya–Gamma sampler for a generalized logistic regression
• Constructing optimal transition matrix for Markov chain Monte Carlo
• On the efficiency of pseudo-marginal random walk Metropolis algorithms
• Adaptive thermostats for noisy gradient systems
• Bayesian Multivariate Mixed Poisson Models with Copula-Based Mixture
• A comparison and catalog of intrinsic tumor growth models
• An improvement of a cryptanalysis algorithm
• Variable transformation to obtain geometric ergodicity in the random-walk Metropolis algorithm
• Stability of adversarial Markov chains, with an application to adaptive MCMC algorithms
• A new probabilistic constraint logic programming language based on a generalised distribution semantics
• MEASURING MODEL RISK IN FINANCIAL RISK MANAGEMENT AND PRICING
• Estimation of time-varying autoregressive stochastic volatility models with stable innovations
• On Irreversible Metropolis Sampling Related to Langevin Dynamics
• Bayesian inference and model comparison for random choice structures
• Practical identifiability of parametrised models: a review of benefits and limitations of various approaches
• Hybrid Monte Carlo on Hilbert spaces
• A generalized multiple-try version of the reversible jump algorithm
• A neural network assisted Metropolis adjusted Langevin algorithm
• Particle MCMC algorithms and architectures for accelerating inference in state-space models
• Bayesian approach to the logistic regression model using Markov chain Monte Carlo methods
• Ergodicity of combocontinuous adaptive MCMC algorithms
• Hilbert space methods for reduced-rank Gaussian process regression
• Practical Hilbert space approximate Bayesian Gaussian processes for probabilistic programming
• Robustness against outliers: A new variance inflated regression model for proportions
• Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
• f-SAEM: a fast stochastic approximation of the EM algorithm for nonlinear mixed effects models
• Hamiltonian-Assisted Metropolis Sampling
• Parameter estimation for reflected Ornstein-Uhlenbeck processes with discrete observations
• Three-point functions in a \(\mathcal{N} = 2\) superconformal gauge theory and their strong-coupling limit
• An Acceleration Strategy for Randomize-Then-Optimize Sampling Via Deep Neural Networks
• The potential and perils of preprocessing: building new foundations
• Nonparametric Bayesian label prediction on a large graph using truncated Laplacian regularization
• Markov-chain Monte-Carlo methods and non-identifiabilities
• Simulating Coulomb and log-gases with hybrid Monte Carlo algorithms
• Reflections on Bayesian inference and Markov chain Monte Carlo
• Handbook of Monte Carlo Methods
• The linear birth-death process: an inferential retrospective
• Diffusion approximations and control variates for MCMC
• A MCMC method based on surrogate model and Gaussian process parameterization for infinite Bayesian PDE inversion
• On bias reduction in parametric estimation in stage structured development models
• Model choice using reversible jump Markov chain Monte Carlo
• Bayesian Conditional Transformation Models
• Efficient Multimodal Sampling via Tempered Distribution Flow
• A new likelihood inequality for models with latent variables
• Deterministic sampling based on Kullback-Leibler divergence and its applications
• Gaussian processes for Bayesian inverse problems associated with linear partial differential equations
• Scalable conditional deep inverse Rosenblatt transports using tensor trains and gradient-based dimension reduction
• Uncertainty quantification of graph convolution neural network models of evolving processes
• Efficient Posterior Sampling for Bayesian Poisson Regression
• Metropolis-Hastings transition kernel couplings
• Polya tree Monte Carlo method
• RT-MPTs: process models for response-time distributions with diffusion-model kernels
• Less interaction with forward models in Langevin dynamics: enrichment and homotopy
• Splitting methods for differential equations
• Dimension-free mixing times of Gibbs samplers for Bayesian hierarchical models
• Intuitive joint priors for Bayesian linear multilevel models: the R2D2M2 prior
• Convergence rate of multiple-try Metropolis independent sampler
• An integrated method for simultaneous calibration and parameter selection in computer models
• Analyzing Markov chain Monte Carlo output
• An optimal Bayesian strategy for comparing Wiener-hunt deconvolution models in the absence of ground truth
• Statistical inference for stochastic differential equations

This page was built for publication: Handbook of Markov Chain Monte Carlo

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3566744)