Bayesian variable selection with shrinking and diffusing priors
From MaRDI portal
Abstract: We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the well-known spike and slab Gaussian priors with a distinct feature, that is, the prior variances depend on the sample size through which appropriate shrinkage can be achieved. We show the strong selection consistency of the proposed method in the sense that the posterior probability of the true model converges to one even when the number of covariates grows nearly exponentially with the sample size. This is arguably the strongest selection consistency result that has been available in the Bayesian variable selection literature; yet the proposed method can be carried out through posterior sampling with a simple Gibbs sampler. Furthermore, we argue that the proposed method is asymptotically similar to model selection with the penalty. We also demonstrate through empirical work the fine performance of the proposed approach relative to some state of the art alternatives.
Recommendations
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Bayesian high-dimensional screening via MCMC
- Variable selection using shrinkage priors
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
- A variational Bayes approach to variable selection
Cites work
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 6162361 (Why is no real title available?)
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- A tail inequality for quadratic forms of subgaussian random vectors
- AN IN-DEPTH LOOK AT HIGHEST POSTERIOR MODEL SELECTION
- Asymptotic oracle properties of SCAD-penalized least squares estimators
- Bayesian Subset Modeling for High-Dimensional Generalized Linear Models
- Bayesian Variable Selection in Linear Regression
- Bayesian empirical likelihood for quantile regression
- Bayesian model selection in high-dimensional settings
- Bayesian variable selection for high dimensional generalized linear models: convergence rates of the fitted densities
- Bayesian variable selection with shrinking and diffusing priors
- Calibration and empirical Bayes variable selection
- Consistency of objective Bayes factors as the model dimension grows
- Consistency of spike and slab regression
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Consistent model selection criteria on high dimensions
- DASSO: Connections Between the Dantzig Selector and Lasso
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- Estimating the dimension of a model
- Likelihood-based selection and sharp parameter estimation
- Nonconcave penalized likelihood with a diverging number of parameters.
- Optimal predictive model selection.
- Penalized orthogonal-components regression for large \(p\) small \(n\) data
- Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCAR
- Spike and slab variable selection: frequentist and Bayesian strategies
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(only showing first 100 items - show all)- Bayesian constrained variable selection
- Bayesian Stein-type shrinkage estimators in high-dimensional linear regression models
- Targeted random projection for prediction from high-dimensional features
- Additive Bayesian variable selection under censoring and misspecification
- Bayesian variable selection with shrinking and diffusing priors
- A novel Bayesian approach for variable selection in linear regression models
- Bayesian inference for an unknown number of attributes in restricted latent class models
- An extended Langevinized ensemble Kalman filter for non-Gaussian dynamic systems
- Bayesian empirical likelihood of quantile regression with missing observations
- Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
- Variable Selection Via Thompson Sampling
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- Some priors for sparse regression modelling
- Consistency of spike and slab regression
- Bayesian structured variable selection in linear regression models
- Variable selection for high-dimensional genomic data with censored outcomes using group Lasso prior
- High-dimensional multivariate posterior consistency under global-local shrinkage priors
- High-dimensional posterior consistency for hierarchical non-local priors in regression
- Bayesian estimation of large precision matrix based on Cholesky decomposition
- Bayesian analysis in single-index quantile regression with missing observation
- High-dimensional posterior consistency of the Bayesian Lasso
- On the selection consistency of Bayesian structured variable selection
- Disjunct support spike-and-slab priors for variable selection in regression under quasi-sparseness
- Tractable Bayesian variable selection: beyond normality
- Approximate spectral gaps for Markov chain mixing times in high dimensions
- Variable selection using shrinkage priors
- An ensemble EM algorithm for Bayesian variable selection
- An approach of Bayesian variable selection for ultrahigh-dimensional multivariate regression
- Development of network-guided transcriptomic risk score for disease prediction
- Consistent group selection using nonlocal priors in regression
- Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
- Bayesian group selection in logistic regression with application to MRI data analysis
- Consistent group selection with Bayesian high dimensional modeling
- Bayesian inference for high-dimensional linear regression under mnet priors
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- Posterior model consistency in variable selection as the model dimension grows
- Weighted Bayesian bootstrap for scalable posterior distributions
- The expectation-maximization approach for Bayesian additive Cox regression with current status data
- Stochastic matching pursuit for Bayesian variable selection
- A robust Bayesian analysis of variable selection under prior ignorance
- Bayesian Multi-Task Variable Selection with an Application to Differential DAG Analysis
- Neuronized Priors for Bayesian Sparse Linear Regression
- Asymptotic theory of dependent Bayesian multiple testing procedures under possible model misspecification
- Scalable Importance Tempering and Bayesian Variable Selection
- Model selection using mass-nonlocal prior
- Bayes variable selection in semiparametric linear models
- Variance prior forms for high-dimensional Bayesian variable selection
- The EAS approach to variable selection for multivariate response data in high-dimensional settings
- Complexity analysis of Bayesian learning of high-dimensional DAG models and their equivalence classes
- On Joint Estimation of Gaussian Graphical Models for Spatial and Temporal Data
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Bayesian empirical likelihood inference and order shrinkage for autoregressive models
- Variable Selection for High-Dimensional Nodal Attributes in Social Networks with Degree Heterogeneity
- Combining a relaxed EM algorithm with Occam's razor for Bayesian variable selection in high-dimensional regression
- Bayesian model selection with graph structured sparsity
- Bayesian Change Point Detection with Spike-and-Slab Priors
- Bayesian variable selection for linear regression with the κ-G priors
- Projective inference in high-dimensional problems: prediction and feature selection
- Comparison of Bayesian predictive methods for model selection
- Bayesian regression based on principal components for high-dimensional data
- Prior influence in linear regression when the number of covariates increases to infinity
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Bayesian model selection in high-dimensional settings
- Variable selection for quantile autoregressive model: Bayesian methods versus classical methods
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Bayesian adaptive Lasso estimation of large graphical model based on modified Cholesky decomposition
- A Mass-Shifting Phenomenon of Truncated Multivariate Normal Priors
- Posterior graph selection and estimation consistency for high-dimensional Bayesian DAG models
- Bayesian variable selection for correlated covariates via colored cliques
- Subjective Bayesian testing using calibrated prior probabilities
- A majorization-minimization approach to variable selection using spike and slab priors
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- Gibbs posterior for variable selection in high-dimensional classification and data mining
- Particle EM for variable selection
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- Efficient estimation and correction of selection-induced bias with order statistics
- Skinny Gibbs: a consistent and scalable Gibbs sampler for model selection
- Maximum pairwise Bayes factors for covariance structure testing
- A split-and-merge Bayesian variable selection approach for ultrahigh dimensional regression
- Bayesian high-dimensional semi-parametric inference beyond sub-Gaussian errors
- Spike and slab variable selection: frequentist and Bayesian strategies
- Bayesian regularization for graphical models with unequal shrinkage
- Quasi-Bayesian estimation of large Gaussian graphical models
- Bayesian factor-adjusted sparse regression
- Bayesian penalized Buckley-James method for high dimensional bivariate censored regression models
- Bayesian group selection with non-local priors
- Variable selection for partially linear models via Bayesian subset modeling with diffusing prior
- On the non-local priors for sparsity selection in high-dimensional Gaussian DAG models
- Variable selection methods for penalized credible regions based on the Horseshoe+ prior
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- Bayesian Edge Regression in Undirected Graphical Models to Characterize Interpatient Heterogeneity in Cancer
- Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
- Objective Bayesian edge screening and structure selection for Ising networks
- An overview of reciprocal \(L_1\)-regularization for high dimensional regression data
- Bayesian inference in high-dimensional linear models using an empirical correlation-adaptive prior
- Identifying regions of inhomogeneities in spatial processes via an M‐RA and mixture priors
- The Bayesian nested Lasso for mixed frequency regression models
- The EAS approach for graphical selection consistency in vector autoregression models
- Bayesian Estimation of Gaussian Conditional Random Fields
- Discussion
This page was built for publication: Bayesian variable selection with shrinking and diffusing priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q118687)
