The EAS approach to variable selection for multivariate response data in high-dimensional settings
From MaRDI portal
Publication:6135077
DOI10.1214/23-EJS2141arXiv2107.04873OpenAlexW3179152816MaRDI QIDQ6135077FDOQ6135077
Jonathan P. Williams, Salil Koner
Publication date: 23 August 2023
Published in: Electronic Journal of Statistics (Search for Journal in Brave)
Abstract: In this paper, we develop an {em epsilon admissible subsets} (EAS) model selection approach for performing group variable selection in the high-dimensional multivariate regression setting. This EAS strategy is designed to estimate a posterior-like, generalized fiducial distribution over a parsimonious class of models in the setting of correlated predictors and/or in the absence of a sparsity assumption. The effectiveness of our approach, to this end, is demonstrated empirically in simulation studies, and is compared to other state-of-the-art model/variable selection procedures. Furthermore, assuming a matrix-Normal linear model we show that the EAS strategy achieves {em strong model selection consistency} in the high-dimensional setting if there does exist a sparse, true data generating set of predictors. In contrast to Bayesian approaches for model selection, our generalized fiducial approach completely avoids the problem of simultaneously having to specify arbitrary prior distributions for model parameters and penalize model complexity; our approach allows for inference directly on the model complexity. extcolor{black}{Implementation of the method is illustrated through yeast data to identify significant cell-cycle regulating transcription factors.
Full work available at URL: https://arxiv.org/abs/2107.04873
Cites Work
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- High-dimensional multivariate posterior consistency under global-local shrinkage priors
- Bayesian data analysis.
- Statistics for high-dimensional data. Methods, theory and applications.
- Best subset selection via a modern optimization lens
- χ 2-Confidence Sets in High-Dimensional Regression
- Simultaneous multiple response regression and inverse covariance matrix estimation via penalized Gaussian maximum likelihood
- On asymptotically optimal confidence regions and tests for high-dimensional models
- Regularized multivariate regression for identifying master predictors with application to integrative genomics study of breast cancer
- Sparse Reduced-Rank Regression for Simultaneous Dimension Reduction and Variable Selection
- Bayesian variable selection with shrinking and diffusing priors
- Multivariate Bayesian Variable Selection and Prediction
- A Statistical View of Some Chemometrics Regression Tools
- Simultaneous Variable and Covariance Selection With the Multivariate Spike-and-Slab LASSO
- Bayes Model Averaging with Selection of Regressors
- Spike-and-Slab Group Lassos for Grouped Regression and Sparse Generalized Additive Models
- Input selection and shrinkage in multiresponse linear regression
- Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable Selection
- Inequalities for Gamma Function Ratios
- Modified AIC and Cp in multivariate linear regression
- The multivariate Cp
- Necessary and sufficient conditions for variable selection consistency of the Lasso in high dimensions
- Multivariate sparse group lasso for the multivariate multiple linear regression with an arbitrary group structure
- Bayesian variable selection regression of multivariate responses for group data
- An algorithm for the multivariate group lasso with covariance estimation
- Fiducial Theory for Free-Knot Splines
- Nonpenalized variable selection in high-dimensional linear model settings via generalized fiducial inference
This page was built for publication: The EAS approach to variable selection for multivariate response data in high-dimensional settings
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6135077)
