Sequential Monte Carlo on large binary sampling spaces
From MaRDI portal
Abstract: A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for good performance. In this paper, we present such a parametric family for adaptive sampling on high-dimensional binary spaces. A practical motivation for this problem is variable selection in a linear regression context. We want to sample from a Bayesian posterior distribution on the model space using an appropriate version of Sequential Monte Carlo. Raw versions of Sequential Monte Carlo are easily implemented using binary vectors with independent components. For high-dimensional problems, however, these simple proposals do not yield satisfactory results. The key to an efficient adaptive algorithm are binary parametric families which take correlations into account, analogously to the multivariate normal distribution on continuous spaces. We provide a review of models for binary data and make one of them work in the context of Sequential Monte Carlo sampling. Computational studies on real life data with about a hundred covariates suggest that, on difficult instances, our Sequential Monte Carlo approach clearly outperforms standard techniques based on Markov chain exploration.
Recommendations
- Adaptive sampling for Bayesian variable selection
- An adaptive sequential Monte Carlo sampler
- Latent uniform samplers on multivariate binary spaces
- Sequential Monte Carlo Samplers
- In search of lost mixing time: adaptive Markov chain Monte Carlo schemes for Bayesian variable selection with very large p
Cites work
- A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations
- A note on the quadratic exponential binary distribution
- A Primer on Copulas for Count Data
- A sequential particle filter method for static models
- Adaptive sampling for Bayesian variable selection
- An introduction to copulas.
- Bias reduction of maximum likelihood estimates
- Estimating the dimension of a model
- Evolutionary stochastic search for Bayesian model exploration
- Following a moving target -- Monte Carlo inference for dynamic Bayesian models
- Hedonic housing prices and the demand for clean air
- scientific article; zbMATH DE number 3169075 (Why is no real title available?)
- scientific article; zbMATH DE number 3748409 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 1471711 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Inference for Lévy-driven stochastic volatility models via adaptive sequential Monte Carlo
- Miscellanea. A note on generating correlated binary variables
- Miscellanea. Peskun's theorem and a modified discrete-state Gibbs sampler
- Modelling and generating correlated binary variables
- On some models for multivariate binary variables parallel in complexity with the multivariate Gaussian distribution
- On the existence of maximum likelihood estimates in logistic regression models
- On-Line Inference for Hidden Markov Models via Particle Filters
- Post-Newtonian methods: analytic results on the binary problem
- Protein construct storage: bayesian variable selection and prediction with mixtures
- Sequential Imputations and Bayesian Missing Data Problems
- Sequential Monte Carlo Methods for Dynamic Systems
- Sequential Monte Carlo Samplers
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
Cited in
(39)- Marginal reversible jump Markov chain Monte Carlo with application to motor unit number estimation
- Sequential Monte Carlo EM for multivariate probit models
- A Bayesian mixture of Lasso regressions with t-errors
- Simulating longer vectors of correlated binary random variables via multinomial sampling
- Knowledge elicitation via sequential probabilistic inference for high-dimensional prediction
- Tempered particle filtering
- An adaptive MCMC method for Bayesian variable selection in logistic and accelerated failure time regression models
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- Sequential ensemble transform for Bayesian inverse problems
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- Controlled sequential Monte Carlo
- Parallel inference for big data with the group Bayesian method
- Sequential Monte Carlo samplers with independent Markov chain Monte Carlo proposals
- Layered adaptive importance sampling
- On the stability of sequential Monte Carlo methods in high dimensions
- Computation of Gaussian orthant probabilities in high dimension
- An adaptive truncation method for inference in Bayesian nonparametric models
- On the convergence of quantum and sequential Monte Carlo methods
- On the convergence of adaptive sequential Monte Carlo methods
- Learning undirected graphical models using persistent sequential Monte Carlo
- Particle EM for variable selection
- Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets
- Adaptive sampling for Bayesian variable selection
- Efficient Sequential Monte-Carlo Samplers for Bayesian Inference
- Sequential Monte Carlo Samplers: Error Bounds and Insensitivity to Initial Conditions
- Particle MCMC With Poisson Resampling: Parallelization and Continuous Time Models
- Informed proposals for local MCMC in discrete spaces
- An Invitation to Sequential Monte Carlo Samplers
- Advanced Multilevel Monte Carlo Methods
- Methods and Tools for Bayesian Variable Selection and Model Averaging in Normal Linear Regression
- Latent uniform samplers on multivariate binary spaces
- Bayesian nonparametric density autoregression with lag selection
- Finite-sample complexity of sequential Monte Carlo estimators
- Adaptive tuning of Hamiltonian Monte Carlo within sequential Monte Carlo
- Sequential Monte Carlo with model tempering
- Scalable Bayesian bi-level variable selection in generalized linear models
- A metropolized adaptive subspace algorithm for high-dimensional Bayesian variable selection
- Sequential importance sampling of binary sequences
- Bayesian linear regression with sparse priors
This page was built for publication: Sequential Monte Carlo on large binary sampling spaces
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q746260)
