Bayesian projection approaches to variable selection in generalized linear models
From MaRDI portal
Publication:2445776
Abstract: A Bayesian approach to variable selection which is based on the expected Kullback-Leibler divergence between the full model and its projection onto a submodel has recently been suggested in the literature. Here we extend this idea by considering projections onto subspaces defined via some form of constraint on the parameter in the full model. This leads to Bayesian model selection approaches related to the lasso. In the posterior distribution of the projection there is positive probability that some components are exactly zero and the posterior distribution on the model space induced by the projection allows exploration of model uncertainty. We also consider use of the approach in structured variable selection problems such as ANOVA models where it is desired to incorporate main effects in the presence of interactions. Here we make use of projections related to the non-negative garotte which are able to respect the hierarchical constraints. We also prove a consistency result concerning the posterior distribution on the model induced by the projection, and show that for some projections related to the adaptive lasso and non-negative garotte the posterior distribution concentrates on the true model asymptotically.
Recommendations
- Bayesian model selection for generalized linear models using non-local priors
- Model choice in generalised linear models: a Bayesian approach via Kullback-Leibler projections
- Bayesian constrained variable selection
- Bayesian variable selection with shrinking and diffusing priors
- A novel Bayesian approach for variable selection in linear regression models
Cites work
- L 1-Regularization Path Algorithm for Generalized Linear Models
- ``Preconditioning for feature selection and regression in high-dimensional problems
- A case study of stochastic optimization in health policy: Problem formulation and preliminary results
- A new approach to variable selection in least squares problems
- Approximate Bayes factors and accounting for model uncertainty in generalised linear models
- Bayes Factors
- Bayes Model Averaging with Selection of Regressors
- Bayesian hyper-Lassos with non-convex penalization
- Bayesian Hypothesis Testing: A Reference Approach
- Bayesian Measures of Model Complexity and Fit
- Bayesian Model Assessment and Comparison Using Cross-Validation Predictive Densities
- Bayesian model averaging: A tutorial. (with comments and a rejoinder).
- Bayesian variable selection with related predictors
- Benchmark priors for Bayesian model averaging.
- Best Subsets Logistic Regression
- Better Subset Regression Using the Nonnegative Garrote
- Calibration and empirical Bayes variable selection
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- scientific article; zbMATH DE number 720676 (Why is no real title available?)
- scientific article; zbMATH DE number 720686 (Why is no real title available?)
- scientific article; zbMATH DE number 947414 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3249515 (Why is no real title available?)
- Least angle regression. (With discussion)
- Model choice in generalised linear models: a Bayesian approach via Kullback-Leibler projections
- Model choice: a minimum posterior predictive loss approach
- Regularization and Variable Selection Via the Elastic Net
- Statistical Analysis of Financial Data in S-Plus
- Structured variable selection and estimation
- The Adaptive Lasso and Its Oracle Properties
- The Bayesian Lasso
- The choice of variables in multivariate regression: a non-conjugate Bayesian decision theory approach
- The Intrinsic Bayes Factor for Model Selection and Prediction
- Variable selection in qualitative models via an entropic explanatory power
Cited in
(19)- Bayesian binary regression with exponential power link
- A new minimal training sample scheme for intrinsic Bayes factors in censored data
- Bayesian model selection for generalized linear models using non-local priors
- A survey of Bayesian predictive methods for model assessment, selection and comparison
- Projective inference in high-dimensional problems: prediction and feature selection
- Comparison of Bayesian predictive methods for model selection
- Special issue on variable selection and robust procedures
- Bayesian variable selection for high dimensional generalized linear models: convergence rates of the fitted densities
- Bayesian variable selection and computation for generalized linear models with conjugate priors
- Bayesian constrained variable selection
- Model choice in generalised linear models: a Bayesian approach via Kullback-Leibler projections
- scientific article; zbMATH DE number 5224911 (Why is no real title available?)
- Bayesian inference via projections
- Fast, Optimal, and Targeted Predictions Using Parameterized Decision Analysis
- The predictive Lasso
- Advances in projection predictive inference
- Interpretable Model Summaries Using the Wasserstein Distance
- Reversible jump methods for generalised linear models and generalised linear mixed models
- Practical variable selection for generalized additive models
This page was built for publication: Bayesian projection approaches to variable selection in generalized linear models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2445776)
