Sure independence screening in generalized linear models with NP-dimensionality

DOI10.1214/10-AOS798zbMATH Open1206.68157arXiv0903.5255OpenAlexW2016119924MaRDI QIDQ140975FDOQ140975

Authors: Jianqing Fan, Rui Song, Rui Song, Jianqing Fan 

Publication date: 1 December 2010

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: Ultrahigh-dimensional variable selection plays an increasingly important role in contemporary scientific discoveries and statistical research. Among others, Fan and Lv [J. R. Stat. Soc. Ser. B Stat. Methodol. 70 (2008) 849-911] propose an independent screening framework by ranking the marginal correlations. They showed that the correlation ranking procedure possesses a sure independence screening property within the context of the linear model with Gaussian covariates and responses. In this paper, we propose a more general version of the independent learning with ranking the maximum marginal likelihood estimates or the maximum marginal likelihood itself in generalized linear models. We show that the proposed methods, with Fan and Lv [J. R. Stat. Soc. Ser. B Stat. Methodol. 70 (2008) 849-911] as a very special case, also possess the sure screening property with vanishing false selection rate. The conditions under which the independence learning possesses a sure screening is surprisingly simple. This justifies the applicability of such a simple method in a wide spectrum. We quantify explicitly the extent to which the dimensionality can be reduced by independence screening, which depends on the interactions of the covariance matrix of covariates and true parameters. Simulation studies are used to illustrate the utility of the proposed approaches. In addition, we establish an exponential inequality for the quasi-maximum likelihood estimator which is useful for high-dimensional statistical learning.

Full work available at URL: https://arxiv.org/abs/0903.5255

Recommendations

• Robust sure independence screening for nonpolynomial dimensional generalized linear models
• Sure independence screening in ultrahigh dimensional generalized additive models
• A sure independence screening procedure for ultra-high dimensional partially linear additive models
• Sure independence screening adjusted for confounding covariates with ultrahigh dimensional data
• Robust sure independence screening for ultrahigh dimensional non-normal data
• Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models
• Nonparametric independence screening in sparse ultra-high-dimensional additive models
• Independent screening in high-dimensional exponential family predictors’ space
• Principled sure independence screening for Cox models with ultra-high-dimensional covariates
• Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data

zbMATH Keywords

variable selectiongeneralized linear modelsindependent learningsure independent screening

Mathematics Subject Classification ID

Large deviations (60F10) Generalized linear models (logistic models) (62J12) Computational learning theory (68Q32) Statistical distribution theory (62E99)

Cites Work

• The Adaptive Lasso and Its Oracle Properties
• Weak convergence and empirical processes. With applications to statistics
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Title not available (Why is that?)
• Maximum Likelihood Estimation of Misspecified Models
• One-step sparse estimates in nonconcave penalized likelihood models
• High-dimensional generalized linear models and the lasso
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• Title not available (Why is that?)
• Title not available (Why is that?)
• High-dimensional classification using features annealed independence rules
• Consistency and asymptotic normality of the maximum likelihood estimator in generalized linear models
• Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
• M-estimation using penalties or sieves
• Title not available (Why is that?)
• Title not available (Why is that?)
• Probability Inequalities for Sums of Bounded Random Variables
• A Statistical View of Some Chemometrics Regression Tools
• About the constants in Talagrand's concentration inequalities for empirical processes.
• Robust inference for univariate proportional hazards frailty regression models
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• Tilting methods for assessing the influence of components in a classifier
• An Analysis of Transformations Revisited

Cited In (only showing first 100 items - show all)

• Conditional characteristic feature screening for massive imbalanced data
• An iterative approach to distance correlation-based sure independence screening
• The Kendall interaction filter for variable interaction screening in high dimensional classification problems
• A modified mean-variance feature-screening procedure for ultrahigh-dimensional discriminant analysis
• A procedure of linear discrimination analysis with detected sparsity structure for high-dimensional multi-class classification
• Modified SCAD penalty for constrained variable selection problems
• Robust feature screening for high-dimensional survival data
• Asset selection based on high frequency Sharpe ratio
• Feature screening for network autoregression model
• Variable screening for ultrahigh dimensional heterogeneous data via conditional quantile correlations
• Evolution of high-frequency systematic trading: a performance-driven gradient boosting model
• Hypothesis testing sure independence screening for nonparametric regression
• Variable screening for high dimensional time series
• Fused variable screening for massive imbalanced data
• A nonparametric feature screening method for ultrahigh-dimensional missing response
• Feature screening for ultrahigh dimensional categorical data with covariates missing at random
• A note on quantile feature screening via distance correlation
• Surrogate-variable-based model-free feature screening for survival data under the general censoring mechanism
• Copula-based Partial Correlation Screening: a Joint and Robust Approach
• Interaction identification and clique screening for classification with ultra-high dimensional discrete features
• Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models
• Feature screening with large‐scale and high‐dimensional survival data
• A general framework for tensor screening through smoothing
• On sufficient variable screening using log odds ratio filter
• Sufficient variable selection using independence measures for continuous response
• Feature screening and FDR control with knockoff features for ultrahigh-dimensional right-censored data
• An efficient algorithm for joint feature screening in ultrahigh-dimensional Cox's model
• Feature screening based on distance correlation for ultrahigh-dimensional censored data with covariate measurement error
• The cumulative Kolmogorov filter for model-free screening in ultrahigh dimensional data
• Ultrahigh dimensional feature screening for additive model with multivariate response
• Variance ratio screening for ultrahigh dimensional discriminant analysis
• Group screening for ultra-high-dimensional feature under linear model
• Grouped feature screening for ultra-high dimensional data for the classification model
• Independence index sufficient variable screening for categorical responses
• The backbone method for ultra-high dimensional sparse machine learning
• Gini correlation for feature screening
• Feature screening for ultrahigh-dimensional survival data when failure indicators are missing at random
• L2RM: Low-Rank Linear Regression Models for High-Dimensional Matrix Responses
• Model-Free Feature Screening and FDR Control With Knockoff Features
• Conditional SIRS for nonparametric and semiparametric models by marginal empirical likelihood
• Targeted random projection for prediction from high-dimensional features
• Joint feature screening for ultra-high-dimensional sparse additive hazards model by the sparsity-restricted pseudo-score estimator
• A two-stage sparse logistic regression for optimal gene selection in high-dimensional microarray data classification
• A robust variable screening method for high-dimensional data
• Feature screening under missing indicator imputation with non-ignorable missing response
• Uniform joint screening for ultra-high dimensional graphical models
• Composite coefficient of determination and its application in ultrahigh dimensional variable screening
• Sequential feature screening for generalized linear models with sparse ultra-high dimensional data
• Robust composite weighted quantile screening for ultrahigh dimensional discriminant analysis
• Ultra-high dimensional variable screening via Gram-Schmidt orthogonalization
• Interaction screening via canonical correlation
• Non-marginal feature screening for additive hazard model with ultrahigh-dimensional covariates
• Variable screening for ultrahigh dimensional censored quantile regression
• Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models
• Feature screening for ultrahigh-dimensional censored data with varying coefficient single-index model
• A selective overview of feature screening for ultrahigh-dimensional data
• Robust variable selection for generalized linear models with a diverging number of parameters
• A model-free conditional screening approach via sufficient dimension reduction
• Covariance-insured screening
• Feature screening in ultrahigh-dimensional partially linear models with missing responses at random
• Regression adjustment for treatment effect with multicollinearity in high dimensions
• Communication-efficient distributed estimator for generalized linear models with a diverging number of covariates
• Partition-based feature screening for categorical data via RKHS embeddings
• Model-free variable selection for conditional mean in regression
• A scalable surrogate \(L_0\) sparse regression method for generalized linear models with applications to large scale data
• Nonparametric independence screening via favored smoothing bandwidth
• Distributed testing and estimation under sparse high dimensional models
• Feature selection of ultrahigh-dimensional covariates with survival outcomes: a selective review
• Adaptive conditional feature screening
• Correlation rank screening for ultrahigh-dimensional survival data
• Model free feature screening for ultrahigh dimensional data with responses missing at random
• Fused mean-variance filter for feature screening
• Robust feature screening for ultra-high dimensional right censored data via distance correlation
• Feature screening for multi-response varying coefficient models with ultrahigh dimensional predictors
• The sparse MLE for ultrahigh-dimensional feature screening
• Screening and clustering of sparse regressions with finite non-Gaussian mixtures
• A generic sure independence screening procedure
• Category-adaptive variable screening for ultra-high dimensional heterogeneous categorical data
• A simple two-sample test in high dimensions based on \(L^2\)-norm
• Penalized Regression for Multiple Types of Many Features With Missing Data
• Model-free slice screening for ultrahigh-dimensional survival data
• Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models
• Title not available (Why is that?)
• Conditional feature screening for mean and variance functions in models with multiple-index structure
• Censored cumulative residual independent screening for ultrahigh-dimensional survival data
• Conditional quantile correlation screening procedure for ultrahigh-dimensional varying coefficient models
• Model‐free conditional screening for ultrahigh‐dimensional survival data via conditional distance correlation
• Model-Free Conditional Feature Screening with FDR Control
• Forward regression for Cox models with high-dimensional covariates
• Robust conditional nonparametric independence screening for ultrahigh-dimensional data
• Feature screening for nonparametric and semiparametric models with ultrahigh-dimensional covariates
• On Sure Screening with Multiple Responses
• High-dimensional variable screening through kernel-based conditional mean dependence
• Principal components adjusted variable screening
• Ultrahigh dimensional feature screening via projection
• A new nonparametric screening method for ultrahigh-dimensional survival data
• Nonparametric independence feature screening for ultrahigh-dimensional survival data
• Local linear regression on manifolds and its geometric interpretation
• Conditional sure independence screening by conditional marginal empirical likelihood
• Model-free feature screening for high-dimensional survival data

This page was built for publication: Sure independence screening in generalized linear models with NP-dimensionality

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q140975)