Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models

DOI10.1214/15-AOS1356MaRDI QIDQ892254zbMATH OpenOpenAlexFDO

Authors Degui Li, Yuan Ke, Wenyang Zhang

Publication date 18 November 2015

Published in The Annals of Statistics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1510.08683, https://projecteuclid.org/euclid.aos/1444222089

zbMATH Keywords

SCADsparsitylocal maximum likelihoodLASSOultra-high dimensionGSVCMoracle estimation

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20)

Abstract: In this paper, we study the model selection and structure specification for the generalised semi-varying coefficient models (GSVCMs), where the number of potential covariates is allowed to be larger than the sample size. We first propose a penalised likelihood method with the LASSO penalty function to obtain the preliminary estimates of the functional coefficients. Then, using the quadratic approximation for the local log-likelihood function and the adaptive group LASSO penalty (or the local linear approximation of the group SCAD penalty) with the help of the preliminary estimation of the functional coefficients, we introduce a novel penalised weighted least squares procedure to select the significant covariates and identify the constant coefficients among the coefficients of the selected covariates, which could thus specify the semiparametric modelling structure. The developed model selection and structure specification approach not only inherits many nice statistical properties from the local maximum likelihood estimation and nonconcave penalised likelihood method, but also computationally attractive thanks to the computational algorithm that is proposed to implement our method. Under some mild conditions, we establish the asymptotic properties for the proposed model selection and estimation procedure such as the sparsity and oracle property. We also conduct simulation studies to examine the finite sample performance of the proposed method, and finally apply the method to analyse a real data set, which leads to some interesting findings.

Recommendations

• Efficient model selection in semivarying coefficient models
• Variable selection for high-dimensional generalized varying-coefficient models
• Structural identification and variable selection in high-dimensional varying-coefficient models
• Variable selection and estimation in high-dimensional varying-coefficient models
• Estimation and inference for generalized semi-varying coefficient models
• Selection of fixed effects in high-dimensional generalized linear mixed models
• Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models
• Generalized varying coefficient models: A smooth variable selection technique
• Semiparametric approximation methods in multivariate model selection

Cites work

• scientific article; zbMATH DE number 991833 (Why is no real title available?)
• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• A semiparametric model for cluster data
• A semiparametric threshold model for censored longitudinal data analysis
• Asymptotic oracle properties of SCAD-penalized least squares estimators
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• Efficient Estimation and Inferences for Varying-Coefficient Models
• Extended Bayesian information criteria for model selection with large model spaces
• Feature selection for varying coefficient models with ultrahigh-dimensional covariates
• Least angle regression. (With discussion)
• Local rank inference for varying coefficient models
• Maximal spacings in several dimensions
• Model Selection and Estimation in Regression with Grouped Variables
• Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models
• Nearly unbiased variable selection under minimax concave penalty
• New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models
• Nonconcave Penalized Likelihood With NP-Dimensionality
• Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models
• Nonparametric independence screening and structure identification for ultra-high dimensional longitudinal data
• Nonparametric independence screening in sparse ultra-high-dimensional additive models
• On the adaptive elastic net with a diverging number of parameters
• On varying-coefficient independence screening for high-dimensional varying-coefficient models
• One-step sparse estimates in nonconcave penalized likelihood models
• Shrinkage estimation of the varying coefficient model
• Simultaneous analysis of Lasso and Dantzig selector
• Simultaneous confidence band and hypothesis test in generalised varying-coefficient models
• Simultaneous confidence bands and hypothesis testing in varying-coefficient models
• Statistical estimation in generalized multiparameter likelihood models
• Statistical estimation in varying coefficient models
• Statistics for high-dimensional data. Methods, theory and applications.
• Sure independence screening in generalized linear models with NP-dimensionality
• The Adaptive Lasso and Its Oracle Properties
• The sparsity and bias of the LASSO selection in high-dimensional linear regression
• Ultrahigh dimensional feature selection: beyond the linear model
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Variable selection and estimation in high-dimensional varying-coefficient models
• Variable selection for high-dimensional generalized varying-coefficient models
• Variable selection in nonparametric varying-coefficient models for analysis of repeated measurements
• Variable selection in semiparametric regression modeling
• Variable selection using MM algorithms

Cited in

(21)

• Simultaneous selection and inference for varying coefficients with zero regions: a soft-thresholding approach
• Robust Inference for Nonstationary Time Series with Possibly Multiple Changing Periodic Structures
• Smooth-threshold estimating equations for varying coefficient partially nonlinear models based on orthogonality-projection method
• Nonlinear Factor‐Augmented Predictive Regression Models with Functional Coefficients
• A varying coefficient model with matrix valued covariates
• A reproducing kernel Hilbert space approach to high dimensional partially varying coefficient model
• Sparse Learning and Structure Identification for Ultrahigh-Dimensional Image-on-Scalar Regression
• The consistency of model selection for dynamic Semi-varying coefficient models with autocorrelated errors
• Sparsity identification in ultra-high dimensional quantile regression models with longitudinal data
• Variational inference for varying-coefficient model
• Model detection and estimation for varying coefficient panel data models with fixed effects
• Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models
• SiZer inference for generalized varying coefficient models
• Composite coefficient of determination and its application in ultrahigh dimensional variable screening
• Time-varying forecast combination for high-dimensional data
• Variable selection for partially varying coefficient model based on modal regression under high dimensional data
• Varying coefficient functional autoregressive model with application to the U.S. treasuries
• Semiparametric model for covariance regression analysis
• Nonparametric homogeneity pursuit in functional-coefficient models
• Structural identification and variable selection in high-dimensional varying-coefficient models
• Variable-dependent partial dimension reduction

This page was built for publication: Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q892254)