Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
From MaRDI portal
Abstract: Bayesian model selection procedures based on nonlocal alternative prior densities are extended to ultrahigh dimensional settings and compared to other variable selection procedures using precision-recall curves. Variable selection procedures included in these comparisons include methods based on -priors, reciprocal lasso, adaptive lasso, scad, and minimax concave penalty criteria. The use of precision-recall curves eliminates the sensitivity of our conclusions to the choice of tuning parameters. We find that Bayesian variable selection procedures based on nonlocal priors are competitive to all other procedures in a range of simulation scenarios, and we subsequently explain this favorable performance through a theoretical examination of their consistency properties. When certain regularity conditions apply, we demonstrate that the nonlocal procedures are consistent for linear models even when the number of covariates increases sub-exponentially with the sample size . A model selection procedure based on Zellner's -prior is also found to be competitive with penalized likelihood methods in identifying the true model, but the posterior distribution on the model space induced by this method is much more dispersed than the posterior distribution induced on the model space by the nonlocal prior methods. We investigate the asymptotic form of the marginal likelihood based on the nonlocal priors and show that it attains a unique term that cannot be derived from the other Bayesian model selection procedures. We also propose a scalable and efficient algorithm called Simplified Shotgun Stochastic Search with Screening (S5) to explore the enormous model space, and we show that S5 dramatically reduces the computing time without losing the capacity to search the interesting region in the model space. The S5 algorithm is available in an verb R ~package {it BayesS5} on exttt{CRAN}.
Recommendations
- Bayesian variable selection with shrinking and diffusing priors
- Bayesian model selection in high-dimensional settings
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Model selection using mass-nonlocal prior
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
Cited in
(46)- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- Neuronized Priors for Bayesian Sparse Linear Regression
- Scalable Importance Tempering and Bayesian Variable Selection
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Accelerated Bayesian Reciprocal LASSO
- Bayesian approaches to variable selection: a comparative study from practical perspectives
- Unified reciprocal LASSO estimation via least squares approximation
- Bayesian inference on hierarchical nonlocal priors in generalized linear models
- Bayesian model selection in high-dimensional settings
- Variable selection in Bayesian multiple instance regression using shotgun stochastic search
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- Discussions
- Fast Bayesian variable screening using correlation thresholds
- A split-and-merge Bayesian variable selection approach for ultrahigh dimensional regression
- Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
- Bayesian graphical regression
- On the non-local priors for sparsity selection in high-dimensional Gaussian DAG models
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- An adaptive MCMC method for Bayesian variable selection in logistic and accelerated failure time regression models
- Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior
- Two-step mixed-type multivariate Bayesian sparse variable selection with shrinkage priors
- Bayesian variable selection for survival data using inverse moment priors
- Discussion
- BayesS5
- Consistent skinny Gibbs in probit regression
- The reciprocal Bayesian Lasso
- Minimax posterior convergence rates and model selection consistency in high-dimensional DAG models based on sparse Cholesky factors
- Advances in Bayesian model selection consistency for high-dimensional generalized linear models
- On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
- On numerical aspects of Bayesian model selection in high and ultrahigh-dimensional settings
- Concentration of posterior model probabilities and normalized \({L_0}\) criteria
- High-dimensional Bayesian inference in nonparametric additive models
- Bayesian Approaches to Shrinkage and Sparse Estimation
- Probabilistic Community Detection With Unknown Number of Communities
- Two-Stage Bayesian Approach for GWAS With Known Genealogy
- Bayesian Multilevel Network Recovery Selection
- Hyper nonlocal priors for variable selection in generalized linear models
- Bayesian wavelet analysis using nonlocal priors with an application to fMRI analysis
- Bayesian Cox regression for large-scale inference with applications to electronic health records
- Bayesian bandwidth test and selection for high-dimensional banded precision matrices
- Bayesian sparse multivariate regression with asymmetric nonlocal priors for microbiome data analysis
- High-dimensional posterior consistency for hierarchical non-local priors in regression
- Tractable Bayesian variable selection: beyond normality
- Bayesian sparse spiked covariance model with a continuous matrix shrinkage prior
- Development of network-guided transcriptomic risk score for disease prediction
- Consistent group selection using nonlocal priors in regression
This page was built for publication: Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4639592)
