Bayesian variable selection with shrinking and diffusing priors
From MaRDI portal
Abstract: We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the well-known spike and slab Gaussian priors with a distinct feature, that is, the prior variances depend on the sample size through which appropriate shrinkage can be achieved. We show the strong selection consistency of the proposed method in the sense that the posterior probability of the true model converges to one even when the number of covariates grows nearly exponentially with the sample size. This is arguably the strongest selection consistency result that has been available in the Bayesian variable selection literature; yet the proposed method can be carried out through posterior sampling with a simple Gibbs sampler. Furthermore, we argue that the proposed method is asymptotically similar to model selection with the penalty. We also demonstrate through empirical work the fine performance of the proposed approach relative to some state of the art alternatives.
Recommendations
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Bayesian high-dimensional screening via MCMC
- Variable selection using shrinkage priors
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
- A variational Bayes approach to variable selection
Cites work
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 6162361 (Why is no real title available?)
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- A tail inequality for quadratic forms of subgaussian random vectors
- AN IN-DEPTH LOOK AT HIGHEST POSTERIOR MODEL SELECTION
- Asymptotic oracle properties of SCAD-penalized least squares estimators
- Bayesian Subset Modeling for High-Dimensional Generalized Linear Models
- Bayesian Variable Selection in Linear Regression
- Bayesian empirical likelihood for quantile regression
- Bayesian model selection in high-dimensional settings
- Bayesian variable selection for high dimensional generalized linear models: convergence rates of the fitted densities
- Bayesian variable selection with shrinking and diffusing priors
- Calibration and empirical Bayes variable selection
- Consistency of objective Bayes factors as the model dimension grows
- Consistency of spike and slab regression
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Consistent model selection criteria on high dimensions
- DASSO: Connections Between the Dantzig Selector and Lasso
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- Estimating the dimension of a model
- Likelihood-based selection and sharp parameter estimation
- Nonconcave penalized likelihood with a diverging number of parameters.
- Optimal predictive model selection.
- Penalized orthogonal-components regression for large \(p\) small \(n\) data
- Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCAR
- Spike and slab variable selection: frequentist and Bayesian strategies
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(only showing first 100 items - show all)- Bayesian inference for high-dimensional linear regression under mnet priors
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- Posterior model consistency in variable selection as the model dimension grows
- A Bayesian approach for discovering time-delayed differential equation from data
- Weighted Bayesian bootstrap for scalable posterior distributions
- The expectation-maximization approach for Bayesian additive Cox regression with current status data
- Stochastic matching pursuit for Bayesian variable selection
- A robust Bayesian analysis of variable selection under prior ignorance
- Bayesian Multi-Task Variable Selection with an Application to Differential DAG Analysis
- Neuronized Priors for Bayesian Sparse Linear Regression
- Asymptotic theory of dependent Bayesian multiple testing procedures under possible model misspecification
- Scalable Importance Tempering and Bayesian Variable Selection
- Model selection using mass-nonlocal prior
- Bayes variable selection in semiparametric linear models
- Bayesian variable selection on structured logistic-normal mixture models for subgroup analysis
- Variance prior forms for high-dimensional Bayesian variable selection
- The EAS approach to variable selection for multivariate response data in high-dimensional settings
- Complexity analysis of Bayesian learning of high-dimensional DAG models and their equivalence classes
- On Joint Estimation of Gaussian Graphical Models for Spatial and Temporal Data
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Bayesian empirical likelihood inference and order shrinkage for autoregressive models
- Variable Selection for High-Dimensional Nodal Attributes in Social Networks with Degree Heterogeneity
- Combining a relaxed EM algorithm with Occam's razor for Bayesian variable selection in high-dimensional regression
- Bayesian model selection with graph structured sparsity
- Bayesian Change Point Detection with Spike-and-Slab Priors
- Bayesian variable selection for linear regression with the κ-G priors
- Projective inference in high-dimensional problems: prediction and feature selection
- Comparison of Bayesian predictive methods for model selection
- Bayesian regression based on principal components for high-dimensional data
- Posterior consistency in multi-response regression models with non-informative priors for the error covariance matrix in growing dimensions
- Consistent and scalable Bayesian joint variable and graph selection for disease diagnosis leveraging functional brain network
- Bayesian inference on hierarchical nonlocal priors in generalized linear models
- A conditional Bayesian approach with valid inference for high dimensional logistic regression
- Prior influence in linear regression when the number of covariates increases to infinity
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Bayesian model selection in high-dimensional settings
- Variable selection for quantile autoregressive model: Bayesian methods versus classical methods
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Bayesian adaptive Lasso estimation of large graphical model based on modified Cholesky decomposition
- A Mass-Shifting Phenomenon of Truncated Multivariate Normal Priors
- Posterior graph selection and estimation consistency for high-dimensional Bayesian DAG models
- Bayesian variable selection for correlated covariates via colored cliques
- Subjective Bayesian testing using calibrated prior probabilities
- A majorization-minimization approach to variable selection using spike and slab priors
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- Posterior model consistency in high-dimensional Bayesian variable selection with arbitrary priors
- Gibbs posterior for variable selection in high-dimensional classification and data mining
- Particle EM for variable selection
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- Efficient estimation and correction of selection-induced bias with order statistics
- Skinny Gibbs: a consistent and scalable Gibbs sampler for model selection
- Maximum pairwise Bayes factors for covariance structure testing
- A split-and-merge Bayesian variable selection approach for ultrahigh dimensional regression
- Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
- Spike and slab variable selection: frequentist and Bayesian strategies
- Bayesian regularization for graphical models with unequal shrinkage
- Quasi-Bayesian estimation of large Gaussian graphical models
- Bayesian factor-adjusted sparse regression
- Bayesian penalized Buckley-James method for high dimensional bivariate censored regression models
- Bayesian group selection with non-local priors
- Variable selection for partially linear models via Bayesian subset modeling with diffusing prior
- Using prior-data conflict to tune Bayesian regularized regression models
- On the non-local priors for sparsity selection in high-dimensional Gaussian DAG models
- Variable selection methods for penalized credible regions based on the Horseshoe+ prior
- A metropolized adaptive subspace algorithm for high-dimensional Bayesian variable selection
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- Bayesian Edge Regression in Undirected Graphical Models to Characterize Interpatient Heterogeneity in Cancer
- Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
- Dynamic graphical models with variable selection for effective connectivity
- Sparse inverse covariance selection with mass-nonlocal priors
- Objective Bayesian edge screening and structure selection for Ising networks
- An overview of reciprocal \(L_1\)-regularization for high dimensional regression data
- Bayesian quantile regression for partially linear single-index model with longitudinal data
- Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior
- Identifying regions of inhomogeneities in spatial processes via an M‐RA and mixture priors
- The Bayesian nested Lasso for mixed frequency regression models
- The EAS approach for graphical selection consistency in vector autoregression models
- Two-step mixed-type multivariate Bayesian sparse variable selection with shrinkage priors
- Bayesian Estimation of Gaussian Conditional Random Fields
- Discussion
- Bayesian variable selection for multioutcome models through shared shrinkage
- Provably Efficient Posterior Sampling for Sparse Linear Regression via Measure Decomposition
- Variational Bayes for high-dimensional multi-source heterogeneous data with sparse priors
- basad
- A generalized likelihood-based Bayesian approach for scalable joint regression and covariance selection in high dimensions
- Random weighting in LASSO regression
- Bayesian model selection for high-dimensional data
- Variational Inference Aided Variable Selection For Spatially Structured High Dimensional Covariates
- Variable selection for zero-inflated Poisson regression model
- Robust Bayesian variable selection in linear models with spherically symmetric errors
- Bayesian variable selection with strong heredity constraints
- Unified Bayesian theory of sparse linear regression with nuisance parameters
- Bayesian projection approaches to variable selection in generalized linear models
- On the Consistency of Bayesian Variable Selection for High Dimensional Binary Regression and Classification
- Multivariate Bayesian variable selection exploiting dependence structure among outcomes: application to air pollution effects on DNA methylation
- A Bayesian Subset Specific Approach to Joint Selection of Multiple Graphical Models
- Consistent skinny Gibbs in probit regression
- Gene-gene interaction analysis incorporating network information via a structured Bayesian approach
- On the computational complexity of high-dimensional Bayesian variable selection
- Ideal Bayesian Spatial Adaptation
This page was built for publication: Bayesian variable selection with shrinking and diffusing priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q118687)
