Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models

DOI10.1214/15-AOS1356zbMATH Open1327.62262arXiv1510.08683OpenAlexW2221963167MaRDI QIDQ892254FDOQ892254

Authors: Degui Li, Yuan Ke, Wenyang Zhang 

Publication date: 18 November 2015

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: In this paper, we study the model selection and structure specification for the generalised semi-varying coefficient models (GSVCMs), where the number of potential covariates is allowed to be larger than the sample size. We first propose a penalised likelihood method with the LASSO penalty function to obtain the preliminary estimates of the functional coefficients. Then, using the quadratic approximation for the local log-likelihood function and the adaptive group LASSO penalty (or the local linear approximation of the group SCAD penalty) with the help of the preliminary estimation of the functional coefficients, we introduce a novel penalised weighted least squares procedure to select the significant covariates and identify the constant coefficients among the coefficients of the selected covariates, which could thus specify the semiparametric modelling structure. The developed model selection and structure specification approach not only inherits many nice statistical properties from the local maximum likelihood estimation and nonconcave penalised likelihood method, but also computationally attractive thanks to the computational algorithm that is proposed to implement our method. Under some mild conditions, we establish the asymptotic properties for the proposed model selection and estimation procedure such as the sparsity and oracle property. We also conduct simulation studies to examine the finite sample performance of the proposed method, and finally apply the method to analyse a real data set, which leads to some interesting findings.

Full work available at URL: https://arxiv.org/abs/1510.08683

Recommendations

• Efficient model selection in semivarying coefficient models
• Variable selection for high-dimensional generalized varying-coefficient models
• Structural identification and variable selection in high-dimensional varying-coefficient models
• Variable selection and estimation in high-dimensional varying-coefficient models
• Estimation and inference for generalized semi-varying coefficient models
• Selection of fixed effects in high-dimensional generalized linear mixed models
• Forward variable selection for sparse ultra-high-dimensional generalized varying coefficient models
• Generalized varying coefficient models: A smooth variable selection technique
• Semiparametric approximation methods in multivariate model selection

zbMATH Keywords

SCADsparsitylocal maximum likelihoodLASSOultra-high dimensionGSVCMoracle estimation

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20)

Cites Work

• Sure independence screening in generalized linear models with NP-dimensionality
• Nearly unbiased variable selection under minimax concave penalty
• The Adaptive Lasso and Its Oracle Properties
• Least angle regression. (With discussion)
• Extended Bayesian information criteria for model selection with large model spaces
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Title not available (Why is that?)
• Statistics for high-dimensional data. Methods, theory and applications.
• One-step sparse estimates in nonconcave penalized likelihood models
• Simultaneous analysis of Lasso and Dantzig selector
• Title not available (Why is that?)
• Model Selection and Estimation in Regression with Grouped Variables
• Variable selection using MM algorithms
• Feature selection for varying coefficient models with ultrahigh-dimensional covariates
• The sparsity and bias of the LASSO selection in high-dimensional linear regression
• Nonparametric independence screening in sparse ultra-high-dimensional additive models
• On varying-coefficient independence screening for high-dimensional varying-coefficient models
• Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models
• Statistical estimation in varying coefficient models
• New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models
• Variable selection in semiparametric regression modeling
• Efficient Estimation and Inferences for Varying-Coefficient Models
• Shrinkage estimation of the varying coefficient model
• Asymptotic oracle properties of SCAD-penalized least squares estimators
• Variable selection in nonparametric varying-coefficient models for analysis of repeated measurements
• On the adaptive elastic net with a diverging number of parameters
• Asymptotic properties of bridge estimators in sparse high-dimensional regression models
• Simultaneous confidence bands and hypothesis testing in varying-coefficient models
• A semiparametric model for cluster data
• Variable selection for high-dimensional generalized varying-coefficient models
• Ultrahigh dimensional feature selection: beyond the linear model
• Local rank inference for varying coefficient models
• Variable selection and estimation in high-dimensional varying-coefficient models
• Nonparametric independence screening and structure identification for ultra-high dimensional longitudinal data
• Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models
• Simultaneous confidence band and hypothesis test in generalised varying-coefficient models
• Nonconcave Penalized Likelihood With NP-Dimensionality
• Maximal spacings in several dimensions
• Statistical estimation in generalized multiparameter likelihood models
• A semiparametric threshold model for censored longitudinal data analysis

Cited In (21)

• SiZer inference for generalized varying coefficient models
• A reproducing kernel Hilbert space approach to high dimensional partially varying coefficient model
• Smooth-threshold estimating equations for varying coefficient partially nonlinear models based on orthogonality-projection method
• Time-varying forecast combination for high-dimensional data
• Varying coefficient functional autoregressive model with application to the U.S. treasuries
• Semiparametric model for covariance regression analysis
• Simultaneous selection and inference for varying coefficients with zero regions: a soft-thresholding approach
• Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models
• Variable-dependent partial dimension reduction
• Structural identification and variable selection in high-dimensional varying-coefficient models
• A varying coefficient model with matrix valued covariates
• Variable selection for partially varying coefficient model based on modal regression under high dimensional data
• Robust Inference for Nonstationary Time Series with Possibly Multiple Changing Periodic Structures
• Sparse Learning and Structure Identification for Ultrahigh-Dimensional Image-on-Scalar Regression
• Nonlinear Factor‐Augmented Predictive Regression Models with Functional Coefficients
• Nonparametric homogeneity pursuit in functional-coefficient models
• The consistency of model selection for dynamic Semi-varying coefficient models with autocorrelated errors
• Model detection and estimation for varying coefficient panel data models with fixed effects
• Variational inference for varying-coefficient model
• Composite coefficient of determination and its application in ultrahigh dimensional variable screening
• Sparsity identification in ultra-high dimensional quantile regression models with longitudinal data

This page was built for publication: Model selection and structure specification in ultra-high dimensional generalised semi-varying coefficient models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q892254)