Interaction pursuit in high-dimensional multi-response regression via distance correlation
From MaRDI portal
Publication:2012211
Abstract: Feature interactions can contribute to a large proportion of variation in many prediction models. In the era of big data, the coexistence of high dimensionality in both responses and covariates poses unprecedented challenges in identifying important interactions. In this paper, we suggest a two-stage interaction identification method, called the interaction pursuit via distance correlation (IPDC), in the setting of high-dimensional multi-response interaction models that exploits feature screening applied to transformed variables with distance correlation followed by feature selection. Such a procedure is computationally efficient, generally applicable beyond the heredity assumption, and effective even when the number of responses diverges with the sample size. Under mild regularity conditions, we show that this method enjoys nice theoretical properties including the sure screening property, support union recovery, and oracle inequalities in prediction and estimation for both interactions and main effects. The advantages of our method are supported by several simulation studies and real data analysis.
Recommendations
- The EBIC and a sequential procedure for feature selection in interactive linear models with high-dimensional data
- Feature screening via distance correlation learning
- Sequential interaction group selection by the principle of correlation search for high-dimensional interaction models
- On selecting interacting features from high-dimensional data
- Feature screening for multi-response varying coefficient models with ultrahigh dimensional predictors
Cited in
(48)- Robust feature screening via Grothendieck's correlation with FDR control
- Model selection for high-dimensional quadratic regression via regularization
- Nonparametric Interaction Selection
- HiQR: an efficient algorithm for high-dimensional quadratic regression with penalties
- High-Dimensional Interaction Detection With False Sign Rate Control
- The Kendall interaction filter for variable interaction screening in high dimensional classification problems
- Asymptotics of AIC, BIC and \(C_p\) model selection rules in high-dimensional regression
- A General Framework for Identifying Hierarchical Interactions and Its Application to Genomics Data
- Penalized interaction estimation for ultrahigh dimensional quadratic regression
- Scalable Model-Free Feature Screening via Sliced-Wasserstein Dependency
- An Updated Literature Review of Distance Correlation and Its Applications to Time Series
- Kernel copula density estimation of Hellinger correlation
- KOO approach for scalable variable selection problem in large-dimensional regression
- Integrative subgroup analysis for high-dimensional mixed-type multi-response data
- Conditional variable screening for ultra-high dimensional longitudinal data with time interactions
- A generic sure independence screening procedure
- Nonparametric screening for additive quantile regression in ultra-high dimension
- Efficient kernel-based variable selection with sparsistency
- scientific article; zbMATH DE number 7750672 (Why is no real title available?)
- Feature screening via false discovery rate control for linear model with multivariate responses
- Estimation of Low Rank High-Dimensional Multivariate Linear Models for Multi-Response Data
- Structure learning via unstructured kernel-based M-estimation
- Overview of research advance for knockoff methods
- An efficient model-free approach to interaction screening for high dimensional data
- Variable screening via conditional martingale difference divergence
- Interaction terms in distance-based regression
- BOLT-SSI: A Statistical Approach to Screening Interaction Effects for Ultra-High Dimensional Data
- High-dimensional interactions detection with sparse principal Hessian matrix
- Screening and selection for quantile regression using an alternative measure of variable importance
- Feature screening for high-dimensional data with measurement errors using adjusted martingale difference correlation
- Sparse Learning and Structure Identification for Ultrahigh-Dimensional Image-on-Scalar Regression
- Interaction screening in high-dimensional multi-response regression via projected distance correlation
- Feature Screening with Latent Responses
- Conditional-quantile screening for ultrahigh-dimensional survival data via martingale difference correlation
- Hypothesis test in high dimensional multi-response linear models
- Projection correlation between scalar and vector variables and its use in feature screening with multi-response data
- Asymptotic distributions of high-dimensional distance correlation inference
- Model selection for functional linear regression with hierarchical structure
- Envelope-based sparse reduced-rank regression for multivariate linear model
- Sparse hierarchical regression with polynomials
- Nonuniformity of p-values can occur early in diverging dimensions
- Sparse Composite Quantile Regression with Ultra-high Dimensional Heterogeneous Data
- RaSE: A Variable Screening Framework via Random Subspace Ensembles
- Threshold Selection in Feature Screening for Error Rate Control
- Statistical insights into deep neural network learning in subspace classification
- Feature selection by canonical correlation search in high-dimensional multiresponse models with complex group structures
- Interaction screening via canonical correlation
- Heterogeneity exploration for multi-response regression
This page was built for publication: Interaction pursuit in high-dimensional multi-response regression via distance correlation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2012211)
