Structured variable selection and estimation
From MaRDI portal
Abstract: In linear regression problems with related predictors, it is desirable to do variable selection and estimation by maintaining the hierarchical or structural relationships among predictors. In this paper we propose non-negative garrote methods that can naturally incorporate such relationships defined through effect heredity principles or marginality principles. We show that the methods are very easy to compute and enjoy nice theoretical properties. We also show that the methods can be easily extended to deal with more general regression problems such as generalized linear models. Simulations and real examples are used to illustrate the merits of the proposed methods.
Recommendations
Cites work
- A Bayesian Variable-Selection Approach for Analyzing Designed Experiments with Complex Aliasing
- A new approach to variable selection in least squares problems
- Bayesian variable selection with related predictors
- Better Subset Regression Using the Nonnegative Garrote
- Estimating Optimal Transformations for Multiple Regression and Correlation
- Hedonic housing prices and the demand for clean air
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 47310 (Why is no real title available?)
- scientific article; zbMATH DE number 2107836 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Least angle regression. (With discussion)
- Model Selection and Estimation in Regression with Grouped Variables
- On the Non-Negative Garrotte Estimator
- The composite absolute penalties family for grouped and hierarchical variable selection
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Variable selection with the strong heredity constraint and its oracle property
- What is a statistical model? (With comments and rejoinder).
Cited in
(53)- Bayesian variable selection with strong heredity constraints
- Matrix completion discriminant analysis
- Hierarchical sparse modeling: a choice of two group Lasso formulations
- A fresh look at effect aliasing and interactions: some new wine in old bottles
- Regularizers for structured sparsity
- Variable selection for functional linear models with strong heredity constraint
- A-ComVar: a flexible extension of common variance designs
- Structured variable selection in support vector machines
- Bayesian projection approaches to variable selection in generalized linear models
- Estimation and variable selection with exponential weights
- An analysis of penalized interaction models
- Identification of partially linear structure in additive models with an application to gene expression prediction from sequences
- Prediction-based structured variable selection through the receiver operating characteristic curves
- Inference after variable selection using restricted permutation methods
- A lasso for hierarchical interactions
- Comments on ``Grouping strategies and thresholding for high dimension linear models
- A modified adaptive Lasso for identifying interactions in the Cox model with the heredity constraint
- Shrinkage estimation for identification of linear components in additive models
- The log-linear group-lasso estimator and its asymptotic properties
- Group regularized estimation under structural hierarchy
- Factor selection and structural identification in the interaction ANOVA model
- Using the EM algorithm for Bayesian variable selection in logistic regression models with related covariates
- Model selection for high-dimensional quadratic regression via regularization
- High-dimensional interactions detection with sparse principal Hessian matrix
- Interaction screening for ultrahigh-dimensional data
- Sequential interaction group selection by the principle of correlation search for high-dimensional interaction models
- Model selection of hierarchically structured covariates using elastic net
- M-estimation and model identification based on double SCAD penalization
- Nonparametric Interaction Selection
- Penalized interaction estimation for ultrahigh dimensional quadratic regression
- Variable selection with the strong heredity constraint and its oracle property
- On the Non-Negative Garrotte Estimator
- Multicategory vertex discriminant analysis for high-dimensional data
- Model Selection and Estimation in Regression with Grouped Variables
- Structured Variables
- A New Analysis Strategy for Designs With Complex Aliasing
- The EBIC and a sequential procedure for feature selection in interactive linear models with high-dimensional data
- A Note on High-Dimensional Linear Regression With Interactions
- Identifiability of Hierarchical Latent Attribute Models
- svReg: Structural varying‐coefficient regression to differentiate how regional brain atrophy affects motor impairment for Huntington disease severity groups
- A Regression Modeling Approach to Structured Shrinkage Estimation
- Unified model-free interaction screening via CV-entropy filter
- HiQR: an efficient algorithm for high-dimensional quadratic regression with penalties
- Factor selection in screening experiments by aggregation over random models
- High-Dimensional Interaction Detection With False Sign Rate Control
- Accounting for established predictors with the multistep elastic net
- Nonparametric feature screening for interaction effects in ultrahigh-dimensional survival data
- Additive Heredity Model for the Analysis of Mixture-of-Mixtures Experiments
- Variable importance based interaction modelling with an application on initial spread of COVID-19 in China
- GMI: group-level main effects and interactions in high-dimensional data with applications to pathway and interaction discovery in gene expression analysis
- Bayesian structured variable selection in linear regression models
- An easy-to-implement hierarchical standardization for variable selection under strong heredity constraint
- Feature selection guided by structural information
This page was built for publication: Structured variable selection and estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q965141)
