Adjusted Pearson chi-square feature screening for multi-classification with ultrahigh dimensional data
The statistical setting is that of \(n\) independent observations of a categorical response \(Y\) and of \(p\) covariates \(X_1\), \dots, \(X_p\). Let \(S\) be the subset of \(\{1,\dots,p\}\) with the indices of the covariates that statistically relates to the response. The aim of the paper is to develop an estimator \(\hat{S}\) with the sure screening property. This means that \(S\) with high probability is a subset of \(\hat{S}\). The paper considers both categorical and continuous covariates, but the proposed method works by categorizing continuous covariates at their sample percentiles. The estimator \(\hat{S}\) is constructed by ranking the covariates according to an adjusted Pearson chi-square statistic computed separately between the response and each of the covariates. Here adjusted entails that the classical Pearson chi-square statistic is normalized by the logarithm of the number of levels of the covariate. Lower bounds on the probability \(P(S \subseteq \hat{S})\) entailing the sure screening property are provided and proved. These bounds extend previous research in several ways. Firstly, the paper explicitly accounts for both categorical and continuous covariates. Secondly, the bounds are stated explicitly in terms of asymptotic rates on the number of levels \(R\) of the response, the number of levels \(J_k\) of the \(k\)'th covariate (possibly after categorization of a continuous covariate), the number of observations \(n\), and the number of covariates \(p\). That the number of levels \(R\) and \(J_k\) are allowed to increase with the number of observations \(n\) is referred to as diverging classes in the paper. The paper also contains simulation studies supporting the theoretical results, as well as exemplifying small sample behaviour of the proposed methods. Finally, the paper also contains a real data analysis with \(n=497\) and \(p=1125\). This exemplifies the main application of the proposed methodology, namely when \(p\) is larger than \(n\).
- Entropy-based model-free feature screening for ultrahigh-dimensional multiclass classification
- Covariate Information Number for Feature Screening in Ultrahigh-Dimensional Supervised Problems
- Sure feature screening for high-dimensional dichotomous classification
- Model-free feature screening for ultrahigh dimensional discriminant analysis
- Category-adaptive variable screening for ultra-high dimensional heterogeneous categorical data
- Entropy-based model-free feature screening for ultrahigh-dimensional multiclass classification
- Feature screening via distance correlation learning
- Forward regression for ultra-high dimensional variable screening
- High-dimensional classification using features annealed independence rules
- Model-free feature screening for ultrahigh dimensional discriminant analysis
- Model-free feature screening for ultrahigh-dimensional data
- Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models
- Quantile-adaptive model-free variable screening for high-dimensional heterogeneous data
- Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
- Sure independence screening in generalized linear models with NP-dimensionality
- The fused Kolmogorov filter: a nonparametric model-free screening method
- The Kolmogorov filter for variable screening in high-dimensional binary classification
- Feature screening for ultrahigh dimensional categorical data with covariates missing at random
- Regularized quantile regression for ultrahigh-dimensional data with nonignorable missing responses
- Grouped feature screening for ultra-high dimensional data for the classification model
- Multi-class associative classification based on intersection method and extended chi-square testing
- Model-free feature screening for ultrahigh dimensional data via a Pearson chi-square based index
- Variable screening with missing covariates: a discussion of ‘statistical inference for nonignorable missing data problems: a selective review’ by Niansheng Tang and Yuanyuan Ju
- A distribution-free test of independence based on a modified mean variance index
This page was built for publication: Adjusted Pearson chi-square feature screening for multi-classification with ultrahigh dimensional data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1683647)
