Robust rank correlation based screening
From MaRDI portal
Abstract: Independence screening is a variable selection method that uses a ranking criterion to select significant variables, particularly for statistical models with nonpolynomial dimensionality or "large p, small n" paradigms when p can be as large as an exponential of the sample size n. In this paper we propose a robust rank correlation screening (RRCS) method to deal with ultra-high dimensional data. The new procedure is based on the Kendall au correlation coefficient between response and predictor variables rather than the Pearson correlation of existing methods. The new method has four desirable features compared with existing independence screening methods. First, the sure independence screening property can hold only under the existence of a second order moment of predictor variables, rather than exponential tails or alikeness, even when the number of predictor variables grows as fast as exponentially of the sample size. Second, it can be used to deal with semiparametric models such as transformation regression models and single-index models under monotonic constraint to the link function without involving nonparametric estimation even when there are nonparametric functions in the models. Third, the procedure can be largely used against outliers and influence points in the observations. Last, the use of indicator functions in rank correlation screening greatly simplifies the theoretical derivation due to the boundedness of the resulting statistics, compared with previous studies on variable screening. Simulations are carried out for comparisons with existing methods and a real data example is analyzed.
Recommendations
- Sure screening by ranking the canonical correlations
- Some notes on robust sure independence screening
- Censored rank independence screening for high-dimensional survival data
- Robust sure independence screening for ultrahigh dimensional non-normal data
- Robust rank screening for ultrahigh dimensional discriminant analysis
Cites work
- scientific article; zbMATH DE number 43550 (Why is no real title available?)
- scientific article; zbMATH DE number 42417 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3251902 (Why is no real title available?)
- scientific article; zbMATH DE number 3049708 (Why is no real title available?)
- A NEW MEASURE OF RANK CORRELATION
- A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
- A Statistical View of Some Chemometrics Regression Tools
- A unified approach to model selection and sparse recovery using regularized least squares
- An Analysis of Transformations Revisited
- An introduction to copulas.
- Asymptotic properties of bridge estimators in sparse high-dimensional regression models
- Behavior of the NORTA method for correlated random vector generation as the dimension increases
- Efficient Bayesian inference for Gaussian copula regression models
- Efficient estimation in the bivariate normal copula model: Normal margins are least favourable
- Estimates of the Regression Coefficient Based on Kendall's Tau
- Factor profiled sure independence screening
- High-dimensional generalized linear models and the lasso
- Least angle regression. (With discussion)
- Model-free feature screening for ultrahigh-dimensional data
- Non-parametric analysis of a generalized regression model. The maximum rank correlation estimator
- Nonconcave Penalized Likelihood With NP-Dimensionality
- Nonconcave penalized M-estimation with a diverging number of parameters
- Nonconcave penalized likelihood with a diverging number of parameters.
- Nonparametric independence screening in sparse ultra-high-dimensional additive models
- RANK AND PRODUCT-MOMENT CORRELATION
- Regularization and Variable Selection Via the Elastic Net
- Rejoinder: One-step sparse estimates in nonconcave penalized likelihood models
- Robust Statistics
- Robust rank correlation based screening
- Sliced Inverse Regression for Dimension Reduction
- Smoothed rank correlation of the linear transformation regression model
- Statistical challenges with high dimensionality: feature selection in knowledge discovery
- Sure independence screening in generalized linear models with NP-dimensionality
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Ultrahigh dimensional feature selection: beyond the linear model
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(only showing first 100 items - show all)- Feature Screening for Massive Data Analysis by Subsampling
- Tests for high-dimensional single-index models
- The main contributions of robust statistics to statistical science and a new challenge
- Robust sure independence screening for nonpolynomial dimensional generalized linear models
- A selective overview of feature screening for ultrahigh-dimensional data
- Variable selection for high dimensional Gaussian copula regression model: an adaptive hypothesis testing procedure
- Variable screening for ultrahigh dimensional censored quantile regression
- Conditional characteristic feature screening for massive imbalanced data
- Ranking-based variable selection for high-dimensional data
- A note of feature screening via a rank-based coefficient of correlation
- Covariance-insured screening
- Feature screening in ultrahigh-dimensional partially linear models with missing responses at random
- Regression adjustment for treatment effect with multicollinearity in high dimensions
- The Kendall interaction filter for variable interaction screening in high dimensional classification problems
- Model-free variable selection for conditional mean in regression
- A scalable surrogate L₀ sparse regression method for generalized linear models with applications to large scale data
- A modified mean-variance feature-screening procedure for ultrahigh-dimensional discriminant analysis
- Group feature screening via the F statistic
- Are Latent Factor Regression and Sparse Regression Adequate?
- Modified SCAD penalty for constrained variable selection problems
- Feature selection for varying coefficient models with ultrahigh-dimensional covariates
- Model-free conditional independence feature screening for ultrahigh dimensional data
- Model-free feature screening for ultrahigh dimensional censored regression
- Revisiting feature selection for linear models with FDR and power guarantees
- Dynamic tilted current correlation for high dimensional variable screening
- Feature Screening with Conditional Rank Utility for Big-Data Classification
- Variance estimation for sparse ultra-high dimensional varying coefficient models
- Scalable Model-Free Feature Screening via Sliced-Wasserstein Dependency
- Risk spillover network structure learning for correlated financial assets: a directed acyclic graph approach
- Variable selection for single-index varying-coefficient model
- Robust error density estimation in ultrahigh dimensional sparse linear model
- A model-free feature screening approach based on kernel density estimation
- A consistent variable screening procedure with family-wise error control
- The nonparametric Box-Cox model for high-dimensional regression analysis
- Screening Methods for Linear Errors-in-Variables Models in High Dimensions
- Local independence feature screening for nonparametric and semiparametric models by marginal empirical likelihood
- scientific article; zbMATH DE number 7750673 (Why is no real title available?)
- Variable screening for ultrahigh dimensional heterogeneous data via conditional quantile correlations
- Variable screening for high dimensional time series
- Model-free forward screening via cumulative divergence
- Marginal empirical likelihood and sure independence feature screening
- Fused variable screening for massive imbalanced data
- A nonparametric feature screening method for ultrahigh-dimensional missing response
- A note on quantile feature screening via distance correlation
- Feature screening for network autoregression model
- Surrogate-variable-based model-free feature screening for survival data under the general censoring mechanism
- Nonparametric independence screening via favored smoothing bandwidth
- Feature selection of ultrahigh-dimensional covariates with survival outcomes: a selective review
- Adaptive conditional feature screening
- Correlation rank screening for ultrahigh-dimensional survival data
- Model free feature screening for ultrahigh dimensional data with responses missing at random
- Fused mean-variance filter for feature screening
- Robust feature screening for ultra-high dimensional right censored data via distance correlation
- Copula-based Partial Correlation Screening: a Joint and Robust Approach
- Modified martingale difference correlations
- Model-free feature screening for ultrahigh dimensional data through a modified Blum-Kiefer-Rosenblatt correlation
- Broken adaptive ridge regression and its asymptotic properties
- Feature screening for multi-response varying coefficient models with ultrahigh dimensional predictors
- Martingale difference correlation and its use in high-dimensional variable screening
- Optimal estimation of slope vector in high-dimensional linear transformation models
- Robust rank correlation based screening
- Coordinatewise Gaussianization: Theories and Applications
- Robust feature screening for elliptical copula regression model
- Category-adaptive variable screening for ultra-high dimensional heterogeneous categorical data
- A simple two-sample test in high dimensions based on \(L^2\)-norm
- Model-free feature screening via a modified composite quantile correlation
- On sufficient variable screening using log odds ratio filter
- Cluster feature selection in high-dimensional linear models
- Model-free slice screening for ultrahigh-dimensional survival data
- Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models
- Sequential profile Lasso for ultra-high-dimensional partially linear models
- Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data
- Screening-based Bregman divergence estimation with NP-dimensionality
- A sequential approach to feature selection in high-dimensional additive models
- Conditional feature screening for mean and variance functions in models with multiple-index structure
- Conditional quantile correlation screening procedure for ultrahigh-dimensional varying coefficient models
- A selective overview of feature screening methods with applications to neuroimaging data
- Robust statistics: a selective overview and new directions
- The fused Kolmogorov filter: a nonparametric model-free screening method
- Robust conditional nonparametric independence screening for ultrahigh-dimensional data
- Variable screening in multivariate linear regression with high-dimensional covariates
- Forward selection for feature screening and structure identification in varying coefficient models
- A General Framework of Nonparametric Feature Selection in High-Dimensional Data
- Variable Selection for Semiparametric Partially Linear Covariate-Adjusted Regression Models
- A dynamic screening algorithm for hierarchical binary marketing data
- Sure joint feature screening in nonparametric transformation model for right censored data
- Robust sufficient dimension reduction via ball covariance
- Robust estimator of the correlation matrix with sparse Kronecker structure for a high-dimensional matrix-variate
- Ultrahigh dimensional feature screening for additive model with multivariate response
- On Sure Screening with Multiple Responses
- Grouped feature screening for ultrahigh-dimensional classification via Gini distance correlation
- A Pairwise Hotelling Method for Testing High-Dimensional Mean Vectors
- Overview of research advance for knockoff methods
- Conditional distance correlation sure independence screening for ultra-high dimensional survival data
- Interaction screening for high-dimensional heterogeneous data via robust hybrid metrics
- Group-wise semiparametric modeling: a SCSE approach
- Unified mean-variance feature screening for ultrahigh-dimensional regression
- Principal components adjusted variable screening
- Ultrahigh dimensional feature screening via projection
- A new nonparametric screening method for ultrahigh-dimensional survival data
This page was built for publication: Robust rank correlation based screening
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q693749)
