A novel Bayesian approach for variable selection in linear regression models
From MaRDI portal
Abstract: We propose a novel Bayesian approach to the problem of variable selection in multiple linear regression models. In particular, we present a hierarchical setting which allows for direct specification of a-priori beliefs about the number of nonzero regression coefficients as well as a specification of beliefs that given coefficients are nonzero. To guarantee numerical stability, we adopt a -prior with an additional ridge parameter for the unknown regression coefficients. In order to simulate from the joint posterior distribution an intelligent random walk Metropolis-Hastings algorithm which is able to switch between different models is proposed. Testing our algorithm on real and simulated data illustrates that it performs at least on par and often even better than other well-established methods. Finally, we prove that under some nominal assumptions, the presented approach is consistent in terms of model selection.
Recommendations
Cites work
- scientific article; zbMATH DE number 4070082 (Why is no real title available?)
- scientific article; zbMATH DE number 3716572 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3273551 (Why is no real title available?)
- scientific article; zbMATH DE number 3189754 (Why is no real title available?)
- A study of variable selection using \(g\)-prior distribution with ridge parameter
- Bayesian Variable Selection in Linear Regression
- Bayesian adaptive Lasso
- Bayesian adaptive Lasso quantile regression
- Bayesian structured variable selection in linear regression models
- Bayesian variable selection regression for genome-wide association studies and other large-scale problems
- Benchmark priors for Bayesian model averaging.
- Data augmentation for support vector machines
- Dirichlet-Laplace priors for optimal shrinkage
- EMVS: the EM approach to Bayesian variable selection
- Estimating Optimal Transformations for Multiple Regression and Correlation
- Fast Bayesian variable selection for high dimensional linear models: marginal solo spike and slab priors
- Fast model-fitting of Bayesian variable selection regression using the iterative complex factorization algorithm
- Handbook of big data
- Inference from iterative simulation using multiple sequences
- Least angle regression. (With discussion)
- Local shrinkage rules, Lévy processes and regularized regression
- Mixtures of g Priors for Bayesian Variable Selection
- Monte Carlo sampling methods using Markov chains and their applications
- Regression. Models, methods and applications
- Regularization and Variable Selection Via the Elastic Net
- Scalable variational inference for Bayesian variable selection in regression, and its accuracy in genetic association studies
- The Adaptive Lasso and Its Oracle Properties
- The Bayesian Lasso
- The Bayesian adaptive Lasso regression
- The horseshoe estimator for sparse signals
- The horseshoe+ estimator of ultra-sparse signals
- The spike-and-slab LASSO
- Variable Selection in Data Mining
- Variable Selection in Regression Mixture Modeling for the Discovery of Gene Regulatory Networks
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Variable selection via penalized credible regions with Dirichlet-Laplace global-local shrinkage priors
Cited in
(25)- Bayesian inference for high-dimensional linear regression under mnet priors
- Bayesian variable selection for linear models using I-priors
- Objective Bayesian variable selection in linear regression model
- Stochastic matching pursuit for Bayesian variable selection
- Variable Selection in the Presence of Factors: A Model Selection Perspective
- Bayesian variable selection for linear regression with the κ-G priors
- Some connections between Bayesian and non-Bayesian methods for regression model selection
- Variable selection in Bayesian multiple instance regression using shotgun stochastic search
- A loss-based prior for variable selection in linear regression methods
- Comparison of Bayesian objective procedures for variable selection in linear regression
- scientific article; zbMATH DE number 5927243 (Why is no real title available?)
- Big data Bayesian linear regression and variable selection by normal-inverse-gamma summation
- A simple approach in regression variable selection
- scientific article; zbMATH DE number 2020781 (Why is no real title available?)
- Variable selection methods for penalized credible regions based on the Horseshoe+ prior
- scientific article; zbMATH DE number 6536957 (Why is no real title available?)
- Bayesian Variable Selection in Linear Regression
- Bayesian projection approaches to variable selection in generalized linear models
- Bayesian variable selection in linear regression
- Objective Bayesian group variable selection for linear model
- Bayesian structured variable selection in linear regression models
- High-dimensional posterior consistency for hierarchical non-local priors in regression
- Bayesian variable selection using an adaptive powered correlation prior
- Shared Bayesian variable shrinkage in multinomial logistic regression
- Bayesian block-diagonal variable selection and model averaging
This page was built for publication: A novel Bayesian approach for variable selection in linear regression models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2291315)
