Variable selection using shrinkage priors
From MaRDI portal
Abstract: Variable selection has received widespread attention over the last decade as we routinely encounter high-throughput datasets in complex biological and environment research. Most Bayesian variable selection methods are restricted to mixture priors having separate components for characterizing the signal and the noise. However, such priors encounter computational issues in high dimensions. This has motivated continuous shrinkage priors, resembling the two-component priors facilitating computation and interpretability. While such priors are widely used for estimating high-dimensional sparse vectors, selecting a subset of variables remains a daunting task. In this article, we propose a general approach for variable selection with shrinkage priors. The presence of very few tuning parameters makes our method attractive in comparison to adhoc thresholding approaches. The applicability of the approach is not limited to continuous shrinkage priors, but can be used along with any shrinkage prior. Theoretical properties for near-collinear design matrices are investigated and the method is shown to have good performance in a wide range of synthetic data examples.
Recommendations
- Variable Selection with Shrinkage Priors via Sparse Posterior Summaries
- Bayesian variable selection with shrinking and diffusing priors
- Bayesian variable selection for mixed effects model with shrinkage prior
- Variable Selection and Shrinkage: Comparison of Some Approaches
- Shrinkage Inverse Regression Estimation for Model-Free Variable Selection
- Bayesian variable selection
- A variational Bayes approach to variable selection
- scientific article; zbMATH DE number 1034042
- On Bayesian lasso variable selection and the specification of the shrinkage parameter
Cites work
- 10.1162/15324430152748236
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- Bayesian Model Assessment and Comparison Using Cross-Validation Predictive Densities
- Bayesian Variable Selection in Linear Regression
- Bayesian Variable Selection Under Collinearity
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Decoupling shrinkage and selection in Bayesian linear models: a posterior summary perspective
- Dirichlet-Laplace priors for optimal shrinkage
- scientific article; zbMATH DE number 720676 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 1522700 (Why is no real title available?)
- scientific article; zbMATH DE number 1405826 (Why is no real title available?)
- Inference with normal-gamma prior distributions in regression problems
- On the use of non-local prior densities in Bayesian hypothesis tests
- Optimal predictive model selection.
- Sparse Bayesian infinite factor models
- Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
- The Adaptive Lasso and Its Oracle Properties
- The Bayesian Lasso
- The horseshoe estimator for sparse signals
- The Intrinsic Bayes Factor for Model Selection and Prediction
Cited in
(34)- Bayesian variable selection with shrinking and diffusing priors
- Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
- Bayesian group bridge for bi-level variable selection
- Joint Bayesian estimation of voxel activation and inter-regional connectivity in fMRI experiments
- The beta-mixture shrinkage prior for sparse covariances with near-minimax posterior convergence rate
- Sparse linear mixed model selection via streamlined variational Bayes
- Bayesian variable selection for mixed effects model with shrinkage prior
- A global-local approach for detecting hotspots in multiple-response regression
- Bayesian fusion estimation via \(t\) shrinkage
- Shrinkage priors for Bayesian penalized regression
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- Shrinkage Inverse Regression Estimation for Model-Free Variable Selection
- Bayesian variable selection for multioutcome models through shared shrinkage
- Bayesian regression with undirected network predictors with an application to brain connectome data
- Bayesian Approaches to Shrinkage and Sparse Estimation
- Decoupling shrinkage and selection in Bayesian linear models: a posterior summary perspective
- Horseshoe Regularisation for Machine Learning in Complex and Deep Models1
- Neuronized Priors for Bayesian Sparse Linear Regression
- Bayesian tensor response regression with an application to brain activation studies
- A comparative study on high-dimensional bayesian regression with binary predictors
- Detecting communities in attributed networks through bi-direction penalized clustering and its application
- Shrinkage and variable selection by polytopes
- Bayesian hierarchical modeling on covariance valued data
- Structured Shrinkage Priors
- Shrinkage priors via random imaginary data
- Benchmarking sparse variable selection methods for genomic data analyses
- Accelerated Bayesian kernel machine regression: a Gaussian variational approximation with the horseshoe prior
- Multiobject data integration in the study of primary progressive aphasia
- Optimal sparse phase retrieval via a quasi-Bayesian approach
- Inferring synergistic and antagonistic interactions in mixtures of exposures
- Laplace power-expected-posterior priors for logistic regression
- Tail-adaptive Bayesian shrinkage
- Bayesian variable selection in high-dimensional ordinal quantile regression models
- Latent class log-linear models for estimating diagnostic test accuracy without a gold standard: a simulation study
This page was built for publication: Variable selection using shrinkage priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1658484)
