Sure independence screening in generalized linear models with NP-dimensionality
From MaRDI portal
(Redirected from Publication:140975)
Abstract: Ultrahigh-dimensional variable selection plays an increasingly important role in contemporary scientific discoveries and statistical research. Among others, Fan and Lv [J. R. Stat. Soc. Ser. B Stat. Methodol. 70 (2008) 849-911] propose an independent screening framework by ranking the marginal correlations. They showed that the correlation ranking procedure possesses a sure independence screening property within the context of the linear model with Gaussian covariates and responses. In this paper, we propose a more general version of the independent learning with ranking the maximum marginal likelihood estimates or the maximum marginal likelihood itself in generalized linear models. We show that the proposed methods, with Fan and Lv [J. R. Stat. Soc. Ser. B Stat. Methodol. 70 (2008) 849-911] as a very special case, also possess the sure screening property with vanishing false selection rate. The conditions under which the independence learning possesses a sure screening is surprisingly simple. This justifies the applicability of such a simple method in a wide spectrum. We quantify explicitly the extent to which the dimensionality can be reduced by independence screening, which depends on the interactions of the covariance matrix of covariates and true parameters. Simulation studies are used to illustrate the utility of the proposed approaches. In addition, we establish an exponential inequality for the quasi-maximum likelihood estimator which is useful for high-dimensional statistical learning.
Recommendations
- Robust sure independence screening for nonpolynomial dimensional generalized linear models
- Sure independence screening in ultrahigh dimensional generalized additive models
- A sure independence screening procedure for ultra-high dimensional partially linear additive models
- Sure independence screening adjusted for confounding covariates with ultrahigh dimensional data
- Robust sure independence screening for ultrahigh dimensional non-normal data
- Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models
- Nonparametric independence screening in sparse ultra-high-dimensional additive models
- Independent screening in high-dimensional exponential family predictors’ space
- Principled sure independence screening for Cox models with ultra-high-dimensional covariates
- Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data
Cites work
- scientific article; zbMATH DE number 49190 (Why is no real title available?)
- scientific article; zbMATH DE number 3626409 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 3251902 (Why is no real title available?)
- scientific article; zbMATH DE number 3385132 (Why is no real title available?)
- A Statistical View of Some Chemometrics Regression Tools
- About the constants in Talagrand's concentration inequalities for empirical processes.
- An Analysis of Transformations Revisited
- Asymptotic properties of bridge estimators in sparse high-dimensional regression models
- Consistency and asymptotic normality of the maximum likelihood estimator in generalized linear models
- High-dimensional classification using features annealed independence rules
- High-dimensional generalized linear models and the lasso
- M-estimation using penalties or sieves
- Maximum Likelihood Estimation of Misspecified Models
- One-step sparse estimates in nonconcave penalized likelihood models
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- Probability Inequalities for Sums of Bounded Random Variables
- Robust inference for univariate proportional hazards frailty regression models
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Tilting methods for assessing the influence of components in a classifier
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Weak convergence and empirical processes. With applications to statistics
Cited in
(only showing first 100 items - show all)- Screening and clustering of sparse regressions with finite non-Gaussian mixtures
- A general adaptive ridge regression method for generalized linear models: an iterative re-weighting approach
- Inference for sparse linear regression based on the leave-one-covariate-out solution path
- A generic sure independence screening procedure
- Category-adaptive variable screening for ultra-high dimensional heterogeneous categorical data
- A simple two-sample test in high dimensions based on \(L^2\)-norm
- Sure independence screening in ultrahigh dimensional generalized additive models
- Penalized Regression for Multiple Types of Many Features With Missing Data
- Model-free feature screening via a modified composite quantile correlation
- Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models
- A general framework for tensor screening through smoothing
- On sufficient variable screening using log odds ratio filter
- Model-free, monotone invariant and computationally efficient feature screening with data-adaptive threshold
- A new reproducing kernel‐based nonlinear dimension reduction method for survival data
- Feature screening for multiple responses
- Model-free slice screening for ultrahigh-dimensional survival data
- Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models
- Feature screening with large‐scale and high‐dimensional survival data
- Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data
- Adaptively weighted group Lasso for semiparametric quantile regression models
- Screening-based Bregman divergence estimation with NP-dimensionality
- Rejoinder
- Ultrahigh dimensional variable selection through the penalized maximum trimmed likelihood estimator
- Sufficient variable selection using independence measures for continuous response
- Penalized wavelets: embedding wavelets into semiparametric regression
- AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories
- Conditional feature screening for mean and variance functions in models with multiple-index structure
- Censored cumulative residual independent screening for ultrahigh-dimensional survival data
- Conditional quantile correlation screening procedure for ultrahigh-dimensional varying coefficient models
- A selective overview of feature screening methods with applications to neuroimaging data
- Feature screening and FDR control with knockoff features for ultrahigh-dimensional right-censored data
- An overview of reciprocal \(L_1\)-regularization for high dimensional regression data
- The fused Kolmogorov filter: a nonparametric model-free screening method
- scientific article; zbMATH DE number 7370575 (Why is no real title available?)
- Forward regression for Cox models with high-dimensional covariates
- An efficient algorithm for joint feature screening in ultrahigh-dimensional Cox's model
- Feature screening based on distance correlation for ultrahigh-dimensional censored data with covariate measurement error
- Robust conditional nonparametric independence screening for ultrahigh-dimensional data
- Model‐free conditional screening for ultrahigh‐dimensional survival data via conditional distance correlation
- Model-Free Conditional Feature Screening with FDR Control
- Feature screening for nonparametric and semiparametric models with ultrahigh-dimensional covariates
- The cumulative Kolmogorov filter for model-free screening in ultrahigh dimensional data
- Variable selection in censored quantile regression with high dimensional data
- A dynamic screening algorithm for hierarchical binary marketing data
- Signal-noise ratio of genetic associations and statistical power of SNP-set tests
- Sure joint feature screening in nonparametric transformation model for right censored data
- Maximum likelihood estimation in logistic regression models with a diverging number of covariates
- Detecting rare and faint signals via thresholding maximum likelihood estimators
- Ultrahigh dimensional feature screening for additive model with multivariate response
- GEE-Assisted Variable Selection for Latent Variable Models with Multivariate Binary Data
- Wasserstein filter for variable screening in binary classification in the reproducing kernel Hilbert space
- On Sure Screening with Multiple Responses
- Grouped feature screening for ultrahigh-dimensional classification via Gini distance correlation
- Variance estimation based on blocked \(3\times 2\) cross-validation in high-dimensional linear regression
- Measures of Uncertainty for Shrinkage Model Selection
- Structure learning via unstructured kernel-based M-estimation
- SIS
- Overview of research advance for knockoff methods
- Time-varying dynamic Bayesian network learning for an fMRI study of emotion processing
- Sequential Text-Term Selection in Vector Space Models
- Interaction screening for high-dimensional heterogeneous data via robust hybrid metrics
- Markov neighborhood regression for statistical inference of high-dimensional generalized linear models
- Variance ratio screening for ultrahigh dimensional discriminant analysis
- Variable selection for additive partial linear quantile regression with missing covariates
- High-dimensional variable screening through kernel-based conditional mean dependence
- Principal components adjusted variable screening
- Ultrahigh dimensional feature screening via projection
- A new nonparametric screening method for ultrahigh-dimensional survival data
- Group screening for ultra-high-dimensional feature under linear model
- Learning Moral Graphs in Construction of High-Dimensional Bayesian Networks for Mixed Data
- BOLT-SSI: A Statistical Approach to Screening Interaction Effects for Ultra-High Dimensional Data
- Hybrid Hard-Soft Screening for High-dimensional Latent Class Analysis
- Robust Feature Screening via Distance Correlation for Ultrahigh Dimensional Data With Responses Missing at Random
- Bayesian high-dimensional screening via MCMC
- Variables selection using \(\mathcal{L}_0\) penalty
- Nonparametric Prediction Distribution from Resolution-Wise Regression with Heterogeneous Data
- Quantile Correlation-based Variable Selection
- Targeting Predictors Via Partial Distance Correlation With Applications to Financial Forecasting
- Optimized variable selection via repeated data splitting
- Feature screening for time-varying coefficient models with ultrahigh-dimensional longitudinal data
- Nonparametric independence feature screening for ultrahigh-dimensional survival data
- Independence index sufficient variable screening for categorical responses
- The backbone method for ultra-high dimensional sparse machine learning
- Grouped feature screening for ultra-high dimensional data for the classification model
- Screening and selection for quantile regression using an alternative measure of variable importance
- Interaction screening for ultrahigh-dimensional data
- Measuring and testing for interval quantile dependence
- Gini correlation for feature screening
- Local linear regression on manifolds and its geometric interpretation
- Feature screening for ultrahigh-dimensional survival data when failure indicators are missing at random
- Conditional sure independence screening by conditional marginal empirical likelihood
- Factor-Adjusted Regularized Model Selection
- L2RM: Low-Rank Linear Regression Models for High-Dimensional Matrix Responses
- Model-free feature screening for high-dimensional survival data
- Sure screening by ranking the canonical correlations
- A classification for complex imbalanced data in disease screening and early diagnosis
- Lq-based robust analytics on ultrahigh and high dimensional data
- Interaction screening via Kendall's rank correlation for imbalanced multi-class classification
- Variable screening and selection for ultra-high dimensional additive quantile regression with missing data
- Score Tests With Incomplete Covariates and High-Dimensional Auxiliary Variables
This page was built for publication: Sure independence screening in generalized linear models with NP-dimensionality
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q140975)
