High-dimensional posterior consistency for hierarchical non-local priors in regression
From MaRDI portal
Publication:2297241
Abstract: The choice of tuning parameters in Bayesian variable selection is a critical problem in modern statistics. In particular, for Bayesian linear regression with non-local priors, the scale parameter in the non-local prior density is an important tuning parameter which reflects the dispersion of the non-local prior density around zero, and implicitly determines the size of the regression coefficients that will be shrunk to zero. Current approaches treat the scale parameter as given, and suggest choices based on prior coverage/asymptotic considerations. In this paper, we consider the fully Bayesian approach introduced in (Wu, 2016) with the pMOM non-local prior and an appropriate Inverse-Gamma prior on the tuning parameter to analyze the underlying theoretical property. Under standard regularity assumptions, we establish strong model selection consistency in a high-dimensional setting, where is allowed to increase at a polynomial rate with n$or even at a sub-exponential rate with n. Through simulation studies, we demonstrate that our model selection procedure can outperform other Bayesian methods which treat the scale parameter as given, and commonly used penalized likelihood methods, in a range of simulation settings.
Recommendations
- Bayesian variable selection with shrinking and diffusing priors
- Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
- A novel Bayesian approach for variable selection in linear regression models
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
- Variable selection consistency of Gaussian process regression
Cites work
- Bayesian linear regression with sparse priors
- Bayesian model selection in high-dimensional settings
- Bayesian variable selection with shrinking and diffusing priors
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- High-dimensional variable selection with reciprocal \(L_{1}\)-regularization
- scientific article; zbMATH DE number 4070082 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Mixtures of g Priors for Bayesian Variable Selection
- On the use of non-local prior densities in Bayesian hypothesis tests
- Posterior graph selection and estimation consistency for high-dimensional Bayesian DAG models
- Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
- Spike and slab variable selection: frequentist and Bayesian strategies
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(18)- Hierarchical shrinkage priors for regression models
- Variable selection consistency of Gaussian process regression
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- Hierarchical shrinkage priors and model fitting for high-dimensional generalized linear models
- On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
- Bayesian Approaches to Shrinkage and Sparse Estimation
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- On the non-local priors for sparsity selection in high-dimensional Gaussian DAG models
- Disjunct support spike-and-slab priors for variable selection in regression under quasi-sparseness
- Development of network-guided transcriptomic risk score for disease prediction
- Consistent group selection using nonlocal priors in regression
- Consistent skinny Gibbs in probit regression
- Accelerated Bayesian Reciprocal LASSO
- Bayesian inference on hierarchical nonlocal priors in generalized linear models
- Sparse inverse covariance selection with mass-nonlocal priors
- Two-step mixed-type multivariate Bayesian sparse variable selection with shrinkage priors
- Scalable network-driven variable selection in Bayesian linear regression
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
This page was built for publication: High-dimensional posterior consistency for hierarchical non-local priors in regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2297241)
