A study of variable selection using g-prior distribution with ridge parameter

DOI10.1016/J.CSDA.2011.11.017MaRDI QIDQ434980zbMATH OpenOpenAlexWikidataFDO

Authors M. Baragatti, D. Pommeret

Publication date 16 July 2012

Published in Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1102.0470

zbMATH Keywords

generalized linear mixed modelstochastic search variable selectionBayesian lassoMetropolis-within-Gibbs algorithmprobit mixed regression modelridge parameterZellner prior

Mathematics Subject Classification ID

Bayesian inference (62F15) Linear regression; mixed models (62J05) Bayesian problems; characterization of Bayes procedures (62C10)

Abstract: In the Bayesian stochastic search variable selection framework, a common prior distribution for the regression coefficients is the g-prior of Zellner (1986). However, there are two standard cases in which the associated covariance matrix does not exist, and the conventional prior of Zellner can not be used: if the number of observations is lower than the number of variables (large p and small n paradigm), or if some variables are linear combinations of others. In such situations a prior distribution derived from the prior of Zellner can be used, by introducing a ridge parameter. This prior introduced by Gupta and Ibrahim (2007) is a flexible and simple adaptation of the g-prior. In this paper we study the influence of the ridge parameter on the selection of variables. A simple way to choose the associated hyper-parameters is proposed. The method is valid for any generalized linear mixed model and we focus on the case of probit mixed models when some variables are linear combinations of others. The method is applied to both simulated and real datasets obtained from Affymetrix microarray experiments. Results are compared to those obtained with the Bayesian Lasso.

Recommendations

• A two-component \(G\)-prior for variable selection
• Mixtures of g Priors for Bayesian Variable Selection
• A mixture of g-priors for variable selection when the number of regressors grows with the sample size
• Mixtures of \(g\)-priors in generalized linear models
• On consistency and optimality of Bayesian variable selection based on \(g\)-prior in normal linear regression models

Cites work

• scientific article; zbMATH DE number 5133222 (Why is no real title available?)
• scientific article; zbMATH DE number 3983087 (Why is no real title available?)
• scientific article; zbMATH DE number 3716572 (Why is no real title available?)
• scientific article; zbMATH DE number 1034042 (Why is no real title available?)
• scientific article; zbMATH DE number 1932867 (Why is no real title available?)
• scientific article; zbMATH DE number 3442988 (Why is no real title available?)
• scientific article; zbMATH DE number 2117879 (Why is no real title available?)
• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• A Bayesian approach to nonlinear probit gene selection and classification
• Bayesian Analysis of Binary and Polychotomous Response Data
• Bayesian Variable Selection in Multinomial Probit Models to Identify Molecular Signatures of Disease Stage
• Bayesian lasso regression
• Bayesian variable selection for probit mixed models applied to gene selection
• Bayesian variable selection in linear regression
• Calibration and empirical Bayes variable selection
• Data augmentation strategies for the Bayesian spatial probit regression model
• Empirical Bayes vs. fully Bayes variable selection
• Evolutionary stochastic search for Bayesian model exploration
• Fully Bayes factors with a generalized g-prior
• Generalized Inverses, Ridge Regression, Biased Linear Estimation, and Nonlinear Estimation
• Hyper-\(g\) priors for generalized linear models
• Marginal Likelihood from the Gibbs Output
• Mixtures of g Priors for Bayesian Variable Selection
• Model Selection and Estimation in Regression with Grouped Variables
• Nonparametric regression using Bayesian variable selection
• Partially Collapsed Gibbs Samplers
• Penalized regression, standard errors, and Bayesian Lassos
• Regularization and Variable Selection Via the Elastic Net
• Regularization in regression: comparing Bayesian and frequentist methods in a poorly informative situation
• Sparsity and Smoothness Via the Fused Lasso
• The Bayesian Lasso
• The Collapsed Gibbs Sampler in Bayesian Computations with Applications to a Gene Regulation Problem
• Variable Selection in Regression Mixture Modeling for the Discovery of Gene Regulatory Networks

Cited in

(14)

• Bayesian functional linear regression with sparse step functions
• Combining a relaxed EM algorithm with Occam's razor for Bayesian variable selection in high-dimensional regression
• Fast Bayesian variable screenings for binary response regressions with small sample size
• Reversible jump Markov chain Monte Carlo algorithms for Bayesian variable selection in logistic mixed models
• Bayesian variable selection with sparse and correlation priors for high-dimensional data analysis
• Applications of Bayesian gene selection and classification with mixtures of generalized singular g-priors
• Mixtures of g Priors for Bayesian Variable Selection
• Bayesian variable selection for finite mixture model of linear regressions
• Bayesian Tobit quantile regression using \(g\)-prior distribution with ridge parameter
• Convergence complexity analysis of Albert and Chib's algorithm for Bayesian probit regression
• A novel Bayesian approach for variable selection in linear regression models
• Wasserstein-based methods for convergence complexity analysis of MCMC with applications
• Bayesian structured variable selection in linear regression models
• A two-component \(G\)-prior for variable selection

This page was built for publication: A study of variable selection using \(g\)-prior distribution with ridge parameter

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q434980)