Bayesian variable selection with shrinking and diffusing priors
From MaRDI portal
Abstract: We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the well-known spike and slab Gaussian priors with a distinct feature, that is, the prior variances depend on the sample size through which appropriate shrinkage can be achieved. We show the strong selection consistency of the proposed method in the sense that the posterior probability of the true model converges to one even when the number of covariates grows nearly exponentially with the sample size. This is arguably the strongest selection consistency result that has been available in the Bayesian variable selection literature; yet the proposed method can be carried out through posterior sampling with a simple Gibbs sampler. Furthermore, we argue that the proposed method is asymptotically similar to model selection with the penalty. We also demonstrate through empirical work the fine performance of the proposed approach relative to some state of the art alternatives.
Recommendations
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Bayesian high-dimensional screening via MCMC
- Variable selection using shrinkage priors
- On Model Selection Consistency of Bayesian Method for Normal Linear Models
- A variational Bayes approach to variable selection
Cites work
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 6162361 (Why is no real title available?)
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- A tail inequality for quadratic forms of subgaussian random vectors
- AN IN-DEPTH LOOK AT HIGHEST POSTERIOR MODEL SELECTION
- Asymptotic oracle properties of SCAD-penalized least squares estimators
- Bayesian Subset Modeling for High-Dimensional Generalized Linear Models
- Bayesian Variable Selection in Linear Regression
- Bayesian empirical likelihood for quantile regression
- Bayesian model selection in high-dimensional settings
- Bayesian variable selection for high dimensional generalized linear models: convergence rates of the fitted densities
- Bayesian variable selection with shrinking and diffusing priors
- Calibration and empirical Bayes variable selection
- Consistency of objective Bayes factors as the model dimension grows
- Consistency of spike and slab regression
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Consistent model selection criteria on high dimensions
- DASSO: Connections Between the Dantzig Selector and Lasso
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- Estimating the dimension of a model
- Likelihood-based selection and sharp parameter estimation
- Nonconcave penalized likelihood with a diverging number of parameters.
- Optimal predictive model selection.
- Penalized orthogonal-components regression for large \(p\) small \(n\) data
- Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCAR
- Spike and slab variable selection: frequentist and Bayesian strategies
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(only showing first 100 items - show all)- Bayesian regression based on principal components for high-dimensional data
- Maximum pairwise Bayes factors for covariance structure testing
- Bayes variable selection in semiparametric linear models
- On Joint Estimation of Gaussian Graphical Models for Spatial and Temporal Data
- Bayesian Estimation of Gaussian Conditional Random Fields
- Combining a relaxed EM algorithm with Occam's razor for Bayesian variable selection in high-dimensional regression
- Multivariate Bayesian variable selection exploiting dependence structure among outcomes: application to air pollution effects on DNA methylation
- Posterior graph selection and estimation consistency for high-dimensional Bayesian DAG models
- High-dimensional posterior consistency of the Bayesian Lasso
- Bayesian variable selection with strong heredity constraints
- BAYESIAN DYNAMIC VARIABLE SELECTION IN HIGH DIMENSIONS
- Unified Bayesian theory of sparse linear regression with nuisance parameters
- Consistent group selection with Bayesian high dimensional modeling
- Minimax posterior convergence rates and model selection consistency in high-dimensional DAG models based on sparse Cholesky factors
- Comparison of Bayesian predictive methods for model selection
- Neuronized Priors for Bayesian Sparse Linear Regression
- Bayesian model selection with graph structured sparsity
- Bayesian projection approaches to variable selection in generalized linear models
- Bayesian factor-adjusted sparse regression
- Some priors for sparse regression modelling
- Strong selection consistency of Bayesian vector autoregressive models based on a pseudo-likelihood approach
- Variable selection consistency of Gaussian process regression
- Prior influence in linear regression when the number of covariates increases to infinity
- Bayesian regularization for graphical models with unequal shrinkage
- Dynamic variable selection with spike-and-slab process priors
- Bayesian constrained variable selection
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Model selection using mass-nonlocal prior
- Spike and slab variable selection: frequentist and Bayesian strategies
- On the Consistency of Bayesian Variable Selection for High Dimensional Binary Regression and Classification
- Adaptive random neighbourhood informed Markov chain Monte Carlo for high-dimensional Bayesian variable selection
- On the computational complexity of high-dimensional Bayesian variable selection
- Bayesian estimation of sparse signals with a continuous spike-and-slab prior
- Bayesian variable selection for correlated covariates via colored cliques
- On the beta prime prior for scale parameters in high-dimensional Bayesian regression models
- Variable selection for partially linear models via Bayesian subset modeling with diffusing prior
- Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
- A split-and-merge Bayesian variable selection approach for ultrahigh dimensional regression
- Bayesian variable selection for linear regression with the κ-G priors
- Variable selection methods for penalized credible regions based on the Horseshoe+ prior
- Scalable Importance Tempering and Bayesian Variable Selection
- Bayesian inference for an unknown number of attributes in restricted latent class models
- Variable selection using shrinkage priors
- A novel Bayesian approach for variable selection in linear regression models
- Consistent high-dimensional Bayesian variable selection via penalized credible regions
- Particle EM for variable selection
- Bayesian model selection in high-dimensional settings
- Posterior model consistency in variable selection as the model dimension grows
- Consistent Bayesian sparsity selection for high-dimensional Gaussian DAG models with multiplicative and beta-mixture priors
- Robust Bayesian variable selection in linear models with spherically symmetric errors
- Bayesian variable selection with spherically symmetric priors
- Skinny Gibbs: a consistent and scalable Gibbs sampler for model selection
- Laplace approximation in high-dimensional Bayesian regression
- Scalable Bayesian variable selection using nonlocal prior densities in ultrahigh-dimensional settings
- Probabilistic Community Detection With Unknown Number of Communities
- Approximate spectral gaps for Markov chain mixing times in high dimensions
- A majorization-minimization approach to variable selection using spike and slab priors
- High-dimensional posterior consistency for hierarchical non-local priors in regression
- Tractable Bayesian variable selection: beyond normality
- basad
- Decoupling shrinkage and selection in Bayesian linear models: a posterior summary perspective
- Pruning variable selection ensembles
- Variable selection for high-dimensional genomic data with censored outcomes using group Lasso prior
- Bayesian Approaches to Shrinkage and Sparse Estimation
- Weighted Bayesian bootstrap for scalable posterior distributions
- High-dimensional multivariate posterior consistency under global-local shrinkage priors
- Quasi-Bayesian estimation of large Gaussian graphical models
- Consistency of spike and slab regression
- Bayesian model selection for high-dimensional data
- Gibbs posterior for variable selection in high-dimensional classification and data mining
- Stochastic matching pursuit for Bayesian variable selection
- Bayesian structured variable selection in linear regression models
- Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics
- Variance prior forms for high-dimensional Bayesian variable selection
- Bayesian variable selection with shrinking and diffusing priors
- Asymptotic theory of dependent Bayesian multiple testing procedures under possible model misspecification
- Bayesian inference for high-dimensional linear regression under mnet priors
- On the non-local priors for sparsity selection in high-dimensional Gaussian DAG models
- Bayesian adaptive Lasso estimation of large graphical model based on modified Cholesky decomposition
- Consistent skinny Gibbs in probit regression
- A Mass-Shifting Phenomenon of Truncated Multivariate Normal Priors
- Gene-gene interaction analysis incorporating network information via a structured Bayesian approach
- Bayesian Edge Regression in Undirected Graphical Models to Characterize Interpatient Heterogeneity in Cancer
- Bayesian Regression Using a Prior on the Model Fit: The R2-D2 Shrinkage Prior
- Objective Bayesian edge screening and structure selection for Ising networks
- A latent slice sampling algorithm
- Bayesian Multi-Task Variable Selection with an Application to Differential DAG Analysis
- Bayesian variable selection for multioutcome models through shared shrinkage
- Bayesian Stein-type shrinkage estimators in high-dimensional linear regression models
- Projective inference in high-dimensional problems: prediction and feature selection
- An approach of Bayesian variable selection for ultrahigh-dimensional multivariate regression
- Additive Bayesian variable selection under censoring and misspecification
- Identifying regions of inhomogeneities in spatial processes via an M‐RA and mixture priors
- Bayesian analysis in single-index quantile regression with missing observation
- Development of network-guided transcriptomic risk score for disease prediction
- Consistent group selection using nonlocal priors in regression
- Joint Bayesian Variable and DAG Selection Consistency for High-dimensional Regression Models with Network-structured Covariates
- Nearly optimal Bayesian shrinkage for high-dimensional regression
- An overview of reciprocal \(L_1\)-regularization for high dimensional regression data
- Subjective Bayesian testing using calibrated prior probabilities
This page was built for publication: Bayesian variable selection with shrinking and diffusing priors
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q118687)
