Sequential Monte Carlo on large binary sampling spaces
From MaRDI portal
Abstract: A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for good performance. In this paper, we present such a parametric family for adaptive sampling on high-dimensional binary spaces. A practical motivation for this problem is variable selection in a linear regression context. We want to sample from a Bayesian posterior distribution on the model space using an appropriate version of Sequential Monte Carlo. Raw versions of Sequential Monte Carlo are easily implemented using binary vectors with independent components. For high-dimensional problems, however, these simple proposals do not yield satisfactory results. The key to an efficient adaptive algorithm are binary parametric families which take correlations into account, analogously to the multivariate normal distribution on continuous spaces. We provide a review of models for binary data and make one of them work in the context of Sequential Monte Carlo sampling. Computational studies on real life data with about a hundred covariates suggest that, on difficult instances, our Sequential Monte Carlo approach clearly outperforms standard techniques based on Markov chain exploration.
Recommendations
- Adaptive sampling for Bayesian variable selection
- An adaptive sequential Monte Carlo sampler
- Latent uniform samplers on multivariate binary spaces
- Sequential Monte Carlo Samplers
- In search of lost mixing time: adaptive Markov chain Monte Carlo schemes for Bayesian variable selection with very large p
Cites work
- scientific article; zbMATH DE number 3169075 (Why is no real title available?)
- scientific article; zbMATH DE number 3748409 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 1471711 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A Primer on Copulas for Count Data
- A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations
- A note on the quadratic exponential binary distribution
- A sequential particle filter method for static models
- Adaptive sampling for Bayesian variable selection
- An introduction to copulas.
- Bias reduction of maximum likelihood estimates
- Estimating the dimension of a model
- Evolutionary stochastic search for Bayesian model exploration
- Following a moving target -- Monte Carlo inference for dynamic Bayesian models
- Hedonic housing prices and the demand for clean air
- Inference for Lévy-driven stochastic volatility models via adaptive sequential Monte Carlo
- Miscellanea. A note on generating correlated binary variables
- Miscellanea. Peskun's theorem and a modified discrete-state Gibbs sampler
- Modelling and generating correlated binary variables
- On some models for multivariate binary variables parallel in complexity with the multivariate Gaussian distribution
- On the existence of maximum likelihood estimates in logistic regression models
- On-Line Inference for Hidden Markov Models via Particle Filters
- Post-Newtonian methods: analytic results on the binary problem
- Protein construct storage: bayesian variable selection and prediction with mixtures
- Sequential Imputations and Bayesian Missing Data Problems
- Sequential Monte Carlo Methods for Dynamic Systems
- Sequential Monte Carlo Samplers
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
Cited in
(37)- An Invitation to Sequential Monte Carlo Samplers
- A Bayesian mixture of Lasso regressions with \(t\)-errors
- Informed proposals for local MCMC in discrete spaces
- Simulating longer vectors of correlated binary random variables via multinomial sampling
- Particle MCMC With Poisson Resampling: Parallelization and Continuous Time Models
- Efficient Sequential Monte-Carlo Samplers for Bayesian Inference
- Advanced Multilevel Monte Carlo Methods
- On the convergence of adaptive sequential Monte Carlo methods
- Sequential Monte Carlo Samplers: Error Bounds and Insensitivity to Initial Conditions
- Knowledge elicitation via sequential probabilistic inference for high-dimensional prediction
- Adaptive tuning of Hamiltonian Monte Carlo within sequential Monte Carlo
- Latent uniform samplers on multivariate binary spaces
- Layered adaptive importance sampling
- Sequential Monte Carlo samplers with independent Markov chain Monte Carlo proposals
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- An adaptive truncation method for inference in Bayesian nonparametric models
- Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets
- Methods and Tools for Bayesian Variable Selection and Model Averaging in Normal Linear Regression
- An adaptive MCMC method for Bayesian variable selection in logistic and accelerated failure time regression models
- Sequential Monte Carlo with model tempering
- Computation of Gaussian orthant probabilities in high dimension
- Parallel inference for big data with the group Bayesian method
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- Sequential Monte Carlo EM for multivariate probit models
- Marginal reversible jump Markov chain Monte Carlo with application to motor unit number estimation
- Sequential importance sampling of binary sequences
- Finite-sample complexity of sequential Monte Carlo estimators
- Tempered particle filtering
- Bayesian linear regression with sparse priors
- Particle EM for variable selection
- On the convergence of quantum and sequential Monte Carlo methods
- Sequential ensemble transform for Bayesian inverse problems
- On the stability of sequential Monte Carlo methods in high dimensions
- Learning undirected graphical models using persistent sequential Monte Carlo
- Adaptive sampling for Bayesian variable selection
- Bayesian nonparametric density autoregression with lag selection
- Controlled sequential Monte Carlo
This page was built for publication: Sequential Monte Carlo on large binary sampling spaces
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q746260)
