Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models

DOI10.1080/01621459.2013.879828MaRDI QIDQ4975577zbMATH OpenOpenAlexWikidataFDO

Authors Yun-bei Ma, Wei Dai, Jianqing Fan

Publication date 7 August 2017

Published in Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1303.0458, http://europepmc.org/articles/pmc4188418

zbMATH Keywords

conditional permutationfalse positive ratessparsitysure independence screeningvariable selection

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08)

Abstract: The varying-coefficient model is an important nonparametric statistical model that allows us to examine how the effects of covariates vary with exposure variables. When the number of covariates is big, the issue of variable selection arrives. In this paper, we propose and investigate marginal nonparametric screening methods to screen variables in ultra-high dimensional sparse varying-coefficient models. The proposed nonparametric independence screening (NIS) selects variables by ranking a measure of the nonparametric marginal contributions of each covariate given the exposure variable. The sure independent screening property is established under some mild technical conditions when the dimensionality is of nonpolynomial order, and the dimensionality reduction of NIS is quantified. To enhance practical utility and the finite sample performance, two data-driven iterative NIS methods are proposed for selecting thresholding parameters and variables: conditional permutation and greedy methods, resulting in Conditional-INIS and Greedy-INIS. The effectiveness and flexibility of the proposed methods are further illustrated by simulation studies and real data applications.

Recommendations

• Nonparametric independence screening in sparse ultra-high-dimensional additive models
• Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data
• On varying-coefficient independence screening for high-dimensional varying-coefficient models
• Robust conditional nonparametric independence screening for ultrahigh-dimensional data
• Marginal empirical likelihood independence screening in sparse ultra-high dimensional additive models
• Sparse high-dimensional varying coefficient model: nonasymptotic minimax study
• Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models
• Nonparametric independence screening and structure identification for ultra-high dimensional longitudinal data
• A sure independence screening procedure for ultra-high dimensional partially linear additive models
• Robust sure independence screening for ultrahigh dimensional non-normal data

Cites work

• Feature screening via distance correlation learning
• Generalized likelihood ratio statistics and Wilks phenomenon
• Hedonic housing prices and the demand for clean air
• Model Selection and Estimation in Regression with Grouped Variables
• Nearly unbiased variable selection under minimax concave penalty
• Nonparametric independence screening in sparse ultra-high-dimensional additive models
• One-step sparse estimates in nonconcave penalized likelihood models
• Optimal global rates of convergence for nonparametric regression
• Principled sure independence screening for Cox models with ultra-high-dimensional covariates
• Regularization and Variable Selection Via the Elastic Net
• Regularization of Wavelet Approximations
• Robust rank correlation based screening
• Statistical methods with varying coefficient models
• Sure independence screening in generalized linear models with NP-dimensionality
• The Adaptive Lasso and Its Oracle Properties
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• Tilting methods for assessing the influence of components in a classifier
• Variable selection in nonparametric varying-coefficient models for analysis of repeated measurements
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties

Cited in

(only showing first 100 items - show all)

• Feature screening for time-varying coefficient models with ultrahigh-dimensional longitudinal data
• Sure independence screening in generalized linear models with NP-dimensionality
• Two-step sparse boosting for high-dimensional longitudinal data with varying coefficients
• Nonparametric independence screening via favored smoothing bandwidth
• Conditional quantile correlation screening procedure for ultrahigh-dimensional varying coefficient models
• Feature screening for generalized varying coefficient models with application to dichotomous responses
• Regularized estimation for the least absolute relative error models with a diverging number of covariates
• Adjusted Pearson chi-square feature screening for multi-classification with ultrahigh dimensional data
• Quantile regression for additive coefficient models in high dimensions
• Model-free conditional independence feature screening for ultrahigh dimensional data
• Robust conditional nonparametric independence screening for ultrahigh-dimensional data
• Variable screening for ultrahigh dimensional heterogeneous data via conditional quantile correlations
• Model-free feature screening for ultrahigh-dimensional data conditional on some variables
• Variable screening for high dimensional time series
• Hypothesis testing sure independence screening for nonparametric regression
• Adaptive varying-coefficient linear quantile model: a profiled estimating equations approach
• Nonparametric independence feature screening for ultrahigh-dimensional survival data
• Feature screening for multi-response varying coefficient models with ultrahigh dimensional predictors
• Feature screening for ultrahigh dimensional categorical data with covariates missing at random
• A note on quantile feature screening via distance correlation
• Shrinkage estimation of the varying-coefficient model with continuous and categorical covariates
• Gini correlation for feature screening
• The de-biased group Lasso estimation for varying coefficient models
• Model-free feature screening via distance correlation for ultrahigh dimensional survival data
• Model averaging prediction for nonparametric varying-coefficient models with B-spline smoothing
• Conditional screening for ultrahigh-dimensional survival data in case-cohort studies
• High-dimensional quantile varying-coefficient models with dimension reduction
• Varying coefficient linear discriminant analysis for dynamic data
• Asset selection based on high frequency Sharpe ratio
• A general framework for tensor screening through smoothing
• On sufficient variable screening using log odds ratio filter
• Independence index sufficient variable screening for categorical responses
• Feature selection for generalized varying coefficient mixed-effect models with application to obesity GWAS
• Conditional SIRS for nonparametric and semiparametric models by marginal empirical likelihood
• Composite quantile regression for ultra-high dimensional semiparametric model averaging
• Screening and selection for quantile regression using an alternative measure of variable importance
• Sufficient variable selection using independence measures for continuous response
• Robust feature screening for elliptical copula regression model
• Rank reduction for high-dimensional generalized additive models
• Test for conditional independence with application to conditional screening
• Feature screening for ultrahigh-dimensional censored data with varying coefficient single-index model
• Feature screening for ultrahigh-dimensional additive logistic models
• Martingale-difference-divergence-based tests for goodness-of-fit in quantile models
• Nonparametric screening under conditional strictly convex loss for ultrahigh dimensional sparse data
• Adaptively weighted group Lasso for semiparametric quantile regression models
• Joint feature screening for ultra-high-dimensional sparse additive hazards model by the sparsity-restricted pseudo-score estimator
• Sparse high-dimensional varying coefficient model: nonasymptotic minimax study
• Sure screening by ranking the canonical correlations
• Nonparametric independence screening for ultra-high dimensional generalized varying coefficient models with longitudinal data
• Feature screening in ultrahigh-dimensional varying-coefficient Cox model
• Local linear smoothing for sparse high dimensional varying coefficient models
• Model-free sure screening via maximum correlation
• Local independence feature screening for nonparametric and semiparametric models by marginal empirical likelihood
• Entropy-based model-free feature screening for ultrahigh-dimensional multiclass classification
• Nonparametric independence screening in sparse ultra-high-dimensional additive models
• On varying-coefficient independence screening for high-dimensional varying-coefficient models
• Nonparametric independence screening for ultra-high-dimensional longitudinal data under additive models
• Greedy forward regression for variable screening
• Nonparametric independence screening and structure identification for ultra-high dimensional longitudinal data
• Quantile screening for ultra-high-dimensional heterogeneous data conditional on some variables
• Dimensionality reduction and variable selection in multivariate varying-coefficient models with a large number of covariates
• Semiparametric Ultra-High Dimensional Model Averaging of Nonlinear Dynamic Time Series
• Copula-based Partial Correlation Screening: a Joint and Robust Approach
• Nonparametric homogeneity pursuit in functional-coefficient models
• A sure independence screening procedure for ultra-high dimensional partially linear additive models
• Projection correlation between scalar and vector variables and its use in feature screening with multi-response data
• On Sure Screening with Multiple Responses
• Model-free feature screening for ultrahigh dimensional data via a Pearson chi-square based index
• Modified adaptive group lasso for high-dimensional varying coefficient models
• Improved Estimation of High-dimensional Additive Models Using Subspace Learning
• Sparse reduced-rank regression for multivariate varying-coefficient models
• Robust feature screening for varying coefficient models via quantile partial correlation
• Variance estimation for sparse ultra-high dimensional varying coefficient models
• Variable selection for partially varying coefficient model based on modal regression under high dimensional data
• Focused information criterion and model averaging for varying-coefficient partially linear models with longitudinal data
• Estimation in partial linear model with spline modal function
• Fast robust feature screening for ultrahigh-dimensional varying coefficient models
• A model-free feature screening approach based on kernel density estimation
• Variable screening for ultrahigh dimensional censored quantile regression
• Ultrahigh dimensional feature screening for additive model with multivariate response
• Nonlinear Factor‐Augmented Predictive Regression Models with Functional Coefficients
• Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models
• Independent screening in high-dimensional exponential family predictors’ space
• Quantile-adaptive variable screening in ultra-high dimensional varying coefficient models
• A robust variable screening method for high-dimensional data
• Marginal empirical likelihood independence screening in sparse ultra-high dimensional additive models
• Principal varying coefficient estimator for high-dimensional models
• Composite coefficient of determination and its application in ultrahigh dimensional variable screening
• Bayesian Hierarchical Varying-Sparsity Regression Models with Application to Cancer Proteogenomics
• Bayesian graphical regression
• Variable selection for sparse high-dimensional nonlinear regression models by combining nonnegative garrote and sure independence screening
• Partial correlation screening for varying coefficient models
• Model-free slice screening for ultrahigh-dimensional survival data
• Sequential profile Lasso for ultra-high-dimensional partially linear models
• AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories
• Sparse Learning and Structure Identification for Ultrahigh-Dimensional Image-on-Scalar Regression
• Robust sure independence screening for nonpolynomial dimensional generalized linear models
• Sure joint feature screening in nonparametric transformation model for right censored data
• Discussion
• Discussion

This page was built for publication: Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4975577)