Piecewise deterministic Markov processes for continuous-time Monte Carlo
From MaRDI portal
Publication:1630397
Abstract: Recently there have been exciting developments in Monte Carlo methods, with the development of new MCMC and sequential Monte Carlo (SMC) algorithms which are based on continuous-time, rather than discrete-time, Markov processes. This has led to some fundamentally new Monte Carlo algorithms which can be used to sample from, say, a posterior distribution. Interestingly, continuous-time algorithms seem particularly well suited to Bayesian analysis in big-data settings as they need only access a small sub-set of data points at each iteration, and yet are still guaranteed to target the true posterior distribution. Whilst continuous-time MCMC and SMC methods have been developed independently we show here that they are related by the fact that both involve simulating a piecewise deterministic Markov process. Furthermore we show that the methods developed to date are just specific cases of a potentially much wider class of continuous-time Monte Carlo algorithms. We give an informal introduction to piecewise deterministic Markov processes, covering the aspects relevant to these new Monte Carlo algorithms, with a view to making the development of new continuous-time Monte Carlo more accessible. We focus on how and why sub-sampling ideas can be used with these algorithms, and aim to give insight into how these new algorithms can be implemented, and what are some of the issues that affect their efficiency.
Recommendations
- Piecewise deterministic Markov processes for scalable Monte Carlo on restricted domains
- Piecewise-deterministic Markov processes
- Piecewise deterministic Markov processes
- Hypocoercivity of piecewise deterministic Markov process-Monte Carlo
- Piecewise deterministic Markov process -- recent results
- scientific article; zbMATH DE number 3901778
- Statistical inference for piecewise-deterministic Markov processes
- A class of piecewise deterministic Markov processes
Cites work
- scientific article; zbMATH DE number 425394 (Why is no real title available?)
- scientific article; zbMATH DE number 3901778 (Why is no real title available?)
- scientific article; zbMATH DE number 3532286 (Why is no real title available?)
- scientific article; zbMATH DE number 1222286 (Why is no real title available?)
- scientific article; zbMATH DE number 6406492 (Why is no real title available?)
- scientific article; zbMATH DE number 6781368 (Why is no real title available?)
- scientific article; zbMATH DE number 2237386 (Why is no real title available?)
- A factorisation of diffusion measure and finite sample path constructions
- A piecewise deterministic scaling limit of lifted Metropolis-Hastings in the Curie-Weiss model
- A short history of Markov chain Monte Carlo: Subjective recollections from incomplete data
- Analysis of a nonreversible Markov chain sampler.
- Blind Deconvolution via Sequential Imputations
- Exact simulation of diffusions
- Limit theorems for the zig-zag process
- Long-term stability of sequential Monte Carlo methods under verifiable conditions
- MCMC using Hamiltonian dynamics
- Non-reversible Metropolis-Hastings
- On Russian roulette estimates for Bayesian inference with doubly-intractable likelihoods
- On the exact and \(\varepsilon\)-strong simulation of (jump) diffusions
- On the stability of interacting processes with applications to filtering and genetic algorithms
- Optimal Scaling of Discrete Approximations to Langevin Diffusions
- Particle Filters for Partially Observed Diffusions
- Piecewise deterministic Markov processes for scalable Monte Carlo on restricted domains
- Retrospective exact simulation of diffusion sample paths with applications
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Sequential Monte Carlo Methods for Dynamic Systems
- Simple, scalable and accurate posterior interval estimation
- Simulation of Brownian motion at first-passage times
- Simulation of nonhomogeneous poisson processes by thinning
- Slice sampling. (With discussions and rejoinder)
- Speeding Up MCMC by Efficient Data Subsampling
- Stochastic differential equations. An introduction with applications
- The Bouncy Particle Sampler: A Non-Reversible Rejection-Free Markov Chain Monte Carlo Method
- The pseudo-marginal approach for efficient Monte Carlo computations
Cited in
(43)- Approximations of piecewise deterministic Markov processes and their convergence properties
- A Quasi Monte Carlo Approach to Piecewise Linear Markov Approximations of Markov Operators
- scientific article; zbMATH DE number 7370608 (Why is no real title available?)
- Concave-Convex PDMP-based Sampling
- Subgeometric hypocoercivity for piecewise-deterministic Markov process Monte Carlo methods
- Low-lying eigenvalues and convergence to the equilibrium of some piecewise deterministic Markov processes generators in the small temperature regime
- Stochastic gradient Markov chain Monte Carlo
- Reversible Jump PDMP Samplers for Variable Selection
- Adaptive schemes for piecewise deterministic Monte Carlo algorithms
- Non-reversible processes: GENERIC, hypocoercivity and fluctuations
- A piecewise deterministic Monte Carlo method for diffusion bridges
- Peskun-Tierney ordering for Markovian Monte Carlo: beyond the reversible scenario
- A note on the polynomial ergodicity of the one-dimensional Zig-Zag process
- A short introduction to piecewise deterministic Markov samplers
- Strong invariance principles for ergodic Markov processes
- The zig-zag process and super-efficient sampling for Bayesian analysis of big data
- Exponential ergodicity of a degenerate age-size piecewise deterministic process
- Log-density gradient covariance and automatic metric tensors for Riemann manifold Monte Carlo methods
- Piecewise deterministic Markov processes for scalable Monte Carlo on restricted domains
- Cores for piecewise-deterministic Markov processes used in Markov chain Monte Carlo
- Speeding up the zig-zag process
- Exponential ergodicity for damping Hamiltonian dynamics with state-dependent and non-local collisions
- On explicit \(L^2\)-convergence rate estimate for piecewise deterministic Markov processes in MCMC algorithms
- Connecting the Dots: Numerical Randomized Hamiltonian Monte Carlo with State-Dependent Event Rates
- Quantifying and Managing Uncertainty in Piecewise-Deterministic Markov Processes
- Computing Bayes: from then `til now
- Editorial: Bayesian computations in the 21st century
- Sampling algorithms in statistical physics: a guide for statistics and machine learning
- An MCMC computational approach for a continuous time state-dependent regime switching diffusion process
- Large deviations for the empirical measure of the zig-zag process
- Constructing sampling schemes via coupling: Markov semigroups and optimal transport
- Tuning diagonal scale matrices for HMC
- Speed up Zig-Zag
- Analysis of stochastic gradient descent in continuous time
- Transport Monte Carlo: High-Accuracy Posterior Approximation via Random Transport
- Informed sub-sampling MCMC: approximate Bayesian inference for large datasets
- Automatic zig-zag sampling in practice
- Collective proposal distributions for nonlinear MCMC samplers: mean-field theory and fast implementation
- Posterior computation with the Gibbs zig-zag sampler
- Generalized Bayesian likelihood-free inference
- Highly Scalable Bayesian Geostatistical Modeling via Meshed Gaussian Processes on Partitioned Domains
- Coordinate sampler: a non-reversible Gibbs-like MCMC sampler
- PDMP characterisation of event-chain Monte Carlo algorithms for particle systems
This page was built for publication: Piecewise deterministic Markov processes for continuous-time Monte Carlo
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1630397)
