Sequential Monte Carlo on large binary sampling spaces
From MaRDI portal
Publication:746260
DOI10.1007/S11222-011-9299-ZzbMATH Open1322.62035arXiv1101.6037OpenAlexW2100404003MaRDI QIDQ746260FDOQ746260
Nicolas Chopin, Christian Schäfer
Publication date: 16 October 2015
Published in: Statistics and Computing (Search for Journal in Brave)
Abstract: A Monte Carlo algorithm is said to be adaptive if it automatically calibrates its current proposal distribution using past simulations. The choice of the parametric family that defines the set of proposal distributions is critical for good performance. In this paper, we present such a parametric family for adaptive sampling on high-dimensional binary spaces. A practical motivation for this problem is variable selection in a linear regression context. We want to sample from a Bayesian posterior distribution on the model space using an appropriate version of Sequential Monte Carlo. Raw versions of Sequential Monte Carlo are easily implemented using binary vectors with independent components. For high-dimensional problems, however, these simple proposals do not yield satisfactory results. The key to an efficient adaptive algorithm are binary parametric families which take correlations into account, analogously to the multivariate normal distribution on continuous spaces. We provide a review of models for binary data and make one of them work in the context of Sequential Monte Carlo sampling. Computational studies on real life data with about a hundred covariates suggest that, on difficult instances, our Sequential Monte Carlo approach clearly outperforms standard techniques based on Markov chain exploration.
Full work available at URL: https://arxiv.org/abs/1101.6037
sequential Monte Carlovariable selectionlinear regressionadaptive Monte Carlomultivariate binary data
Cites Work
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Estimating the dimension of a model
- Sequential Monte Carlo Samplers
- On the existence of maximum likelihood estimates in logistic regression models
- A note on the quadratic exponential binary distribution
- Bias reduction of maximum likelihood estimates
- A Primer on Copulas for Count Data
- An introduction to copulas.
- Hedonic housing prices and the demand for clean air
- Sequential Imputations and Bayesian Missing Data Problems
- A sequential particle filter method for static models
- Sequential Monte Carlo Methods for Dynamic Systems
- Evolutionary stochastic search for Bayesian model exploration
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
- Following a moving target -- Monte Carlo inference for dynamic Bayesian models
- On-Line Inference for Hidden Markov Models via Particle Filters
- Adaptive sampling for Bayesian variable selection
- On some models for multivariate binary variables parallel in complexity with the multivariate Gaussian distribution
- Inference for Lévy-driven stochastic volatility models via adaptive sequential Monte Carlo
- A family of multivariate binary distributions for simulating correlated binary variables with specified marginal means and correlations
- Miscellanea. Peskun's theorem and a modified discrete-state Gibbs sampler
- Modelling and generating correlated binary variables
- Miscellanea. A note on generating correlated binary variables
- Post-Newtonian Methods: Analytic Results on the Binary Problem
- Protein construct storage: bayesian variable selection and prediction with mixtures
Cited In (36)
- Finite-sample complexity of sequential Monte Carlo estimators
- Layered adaptive importance sampling
- An Invitation to Sequential Monte Carlo Samplers
- Parallel inference for big data with the group Bayesian method
- Marginal reversible jump Markov chain Monte Carlo with application to motor unit number estimation
- A Bayesian mixture of Lasso regressions with \(t\)-errors
- On the stability of sequential Monte Carlo methods in high dimensions
- Informed Proposals for Local MCMC in Discrete Spaces
- Bayesian linear regression with sparse priors
- Sequential ensemble transform for Bayesian inverse problems
- On the Convergence of Quantum and Sequential Monte Carlo Methods
- On the convergence of adaptive sequential Monte Carlo methods
- Learning undirected graphical models using persistent sequential Monte Carlo
- Controlled sequential Monte Carlo
- Computation of Gaussian orthant probabilities in high dimension
- An adaptive MCMC method for Bayesian variable selection in logistic and accelerated failure time regression models
- Adaptive tuning of Hamiltonian Monte Carlo within sequential Monte Carlo
- Particle EM for Variable Selection
- Sequential importance sampling of binary sequences
- Simulating longer vectors of correlated binary random variables via multinomial sampling
- Methods and Tools for Bayesian Variable Selection and Model Averaging in Normal Linear Regression
- Model choice problems using approximate Bayesian computation with applications to pathogen transmission data sets
- Sequential Monte Carlo with model tempering
- Efficient Sequential Monte-Carlo Samplers for Bayesian Inference
- Sequential Monte Carlo samplers with independent Markov chain Monte Carlo proposals
- Sequential Monte Carlo Samplers: Error Bounds and Insensitivity to Initial Conditions
- Knowledge elicitation via sequential probabilistic inference for high-dimensional prediction
- Tempered particle filtering
- Particle MCMC With Poisson Resampling: Parallelization and Continuous Time Models
- Advanced Multilevel Monte Carlo Methods
- An adaptive truncation method for inference in Bayesian nonparametric models
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- Latent uniform samplers on multivariate binary spaces
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- Sequential Monte Carlo EM for multivariate probit models
- Bayesian nonparametric density autoregression with lag selection
Uses Software
This page was built for publication: Sequential Monte Carlo on large binary sampling spaces
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q746260)
