Interaction pursuit in high-dimensional multi-response regression via distance correlation
From MaRDI portal
Publication:2012211
Abstract: Feature interactions can contribute to a large proportion of variation in many prediction models. In the era of big data, the coexistence of high dimensionality in both responses and covariates poses unprecedented challenges in identifying important interactions. In this paper, we suggest a two-stage interaction identification method, called the interaction pursuit via distance correlation (IPDC), in the setting of high-dimensional multi-response interaction models that exploits feature screening applied to transformed variables with distance correlation followed by feature selection. Such a procedure is computationally efficient, generally applicable beyond the heredity assumption, and effective even when the number of responses diverges with the sample size. Under mild regularity conditions, we show that this method enjoys nice theoretical properties including the sure screening property, support union recovery, and oracle inequalities in prediction and estimation for both interactions and main effects. The advantages of our method are supported by several simulation studies and real data analysis.
Recommendations
- The EBIC and a sequential procedure for feature selection in interactive linear models with high-dimensional data
- Feature screening via distance correlation learning
- Sequential interaction group selection by the principle of correlation search for high-dimensional interaction models
- On selecting interacting features from high-dimensional data
- Feature screening for multi-response varying coefficient models with ultrahigh dimensional predictors
Cited in
(36)- Interaction screening via canonical correlation
- scientific article; zbMATH DE number 7750672 (Why is no real title available?)
- HiQR: an efficient algorithm for high-dimensional quadratic regression with penalties
- Structure learning via unstructured kernel-based M-estimation
- Estimation of Low Rank High-Dimensional Multivariate Linear Models for Multi-Response Data
- Sparse Learning and Structure Identification for Ultrahigh-Dimensional Image-on-Scalar Regression
- Threshold Selection in Feature Screening for Error Rate Control
- A generic sure independence screening procedure
- Sparse hierarchical regression with polynomials
- Asymptotic distributions of high-dimensional distance correlation inference
- Nonparametric Interaction Selection
- Model selection for high-dimensional quadratic regression via regularization
- High-dimensional interactions detection with sparse principal Hessian matrix
- Scalable Model-Free Feature Screening via Sliced-Wasserstein Dependency
- Overview of research advance for knockoff methods
- Nonuniformity of \(p\)-values can occur early in diverging dimensions
- An efficient model-free approach to interaction screening for high dimensional data
- Efficient kernel-based variable selection with sparsistency
- Screening and selection for quantile regression using an alternative measure of variable importance
- Envelope-based sparse reduced-rank regression for multivariate linear model
- Statistical insights into deep neural network learning in subspace classification
- An Updated Literature Review of Distance Correlation and Its Applications to Time Series
- Sparse Composite Quantile Regression with Ultra-high Dimensional Heterogeneous Data
- Conditional-quantile screening for ultrahigh-dimensional survival data via martingale difference correlation
- Projection correlation between scalar and vector variables and its use in feature screening with multi-response data
- RaSE: A Variable Screening Framework via Random Subspace Ensembles
- High-Dimensional Interaction Detection With False Sign Rate Control
- Feature selection by canonical correlation search in high-dimensional multiresponse models with complex group structures
- Interaction terms in distance-based regression
- A General Framework for Identifying Hierarchical Interactions and Its Application to Genomics Data
- The Kendall interaction filter for variable interaction screening in high dimensional classification problems
- Feature Screening with Latent Responses
- Model selection for functional linear regression with hierarchical structure
- Asymptotics of AIC, BIC and \(C_p\) model selection rules in high-dimensional regression
- BOLT-SSI: A Statistical Approach to Screening Interaction Effects for Ultra-High Dimensional Data
- Penalized interaction estimation for ultrahigh dimensional quadratic regression
This page was built for publication: Interaction pursuit in high-dimensional multi-response regression via distance correlation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2012211)
