A Note on High-Dimensional Linear Regression With Interactions
From MaRDI portal
Abstract: The problem of interaction selection has recently caught much attention in high dimensional data analysis. This note aims to address and clarify several fundamental issues in interaction selection for linear regression models, especially when the input dimension p is much larger than the sample size n. We first discuss issues such as a valid way of defining importance for the main effects and interaction effects, the invariance principle, and the strong heredity condition. Then we focus on two-stage methods, which are computationally attractive for large p problems but regarded heuristic in the literature. We will revisit the counterexample of Turlach (2004) and provide new insight to justify two-stage methods from a theoretical perspective. In the end, we suggest some new strategies for interaction selection under the marginality principle, which is followed by a numerical example.
Cites work
- A Bayesian Variable-Selection Approach for Analyzing Designed Experiments with Complex Aliasing
- A lasso for hierarchical interactions
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- Bayesian variable selection with related predictors
- Extended Bayesian information criteria for model selection with large model spaces
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 47310 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Interaction screening for ultrahigh-dimensional data
- Least angle regression. (With discussion)
- Model selection for high-dimensional quadratic regression via regularization
- Statistics for high-dimensional data. Methods, theory and applications.
- Structured variable selection and estimation
- The Adaptive Lasso and Its Oracle Properties
- The composite absolute penalties family for grouped and hierarchical variable selection
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Variable selection with the strong heredity constraint and its oracle property
- What is a statistical model? (With comments and rejoinder).
Cited in
(15)- scientific article; zbMATH DE number 6670732 (Why is no real title available?)
- Robust gene–environment interaction analysis using penalized trimmed regression
- Model selection for high-dimensional quadratic regression via regularization
- Sequential interaction group selection by the principle of correlation search for high-dimensional interaction models
- Penalized interaction estimation for ultrahigh dimensional quadratic regression
- Unified model-free interaction screening via CV-entropy filter
- A dynamic screening algorithm for hierarchical binary marketing data
- HiQR: an efficient algorithm for high-dimensional quadratic regression with penalties
- Quantile Correlation-based Variable Selection
- Gene-gene interaction analysis incorporating network information via a structured Bayesian approach
- Robust semiparametric gene-environment interaction analysis using sparse boosting
- Adaptive sufficient sparse clustering by controlling false discovery
- Examining the feasibility of quadratic vector autoregressions for psychological intensive longitudinal data
- Quantile-adaptive distributional Granger causal model for high-dimensional time series
- An easy-to-implement hierarchical standardization for variable selection under strong heredity constraint
This page was built for publication: A Note on High-Dimensional Linear Regression With Interactions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6039619)
