Partially linear additive quantile regression in ultra-high dimension
From MaRDI portal
Publication:5963523
DOI10.1214/15-AOS1367zbMATH Open1331.62264arXiv1601.06000MaRDI QIDQ5963523FDOQ5963523
Publication date: 22 February 2016
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: We consider a flexible semiparametric quantile regression model for analyzing high dimensional heterogeneous data. This model has several appealing features: (1) By considering different conditional quantiles, we may obtain a more complete picture of the conditional distribution of a response variable given high dimensional covariates. (2) The sparsity level is allowed to be different at different quantile levels. (3) The partially linear additive structure accommodates nonlinearity and circumvents the curse of dimensionality. (4) It is naturally robust to heavy-tailed distributions. In this paper, we approximate the nonlinear components using B-spline basis functions. We first study estimation under this model when the nonzero components are known in advance and the number of covariates in the linear part diverges. We then investigate a nonconvex penalized estimator for simultaneous variable selection and estimation. We derive its oracle property for a general class of nonconvex penalty functions in the presence of ultra-high dimensional covariates under relaxed conditions. To tackle the challenges of nonsmooth loss function, nonconvex penalty function and the presence of nonlinear components, we combine a recently developed convex-differencing method with modern empirical process techniques. Monte Carlo simulations and an application to a microarray study demonstrate the effectiveness of the proposed method. We also discuss how the method for a single quantile of interest can be extended to simultaneous variable selection and estimation at multiple quantiles.
Full work available at URL: https://arxiv.org/abs/1601.06000
Cites Work
- Nearly unbiased variable selection under minimax concave penalty
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Title not available (Why is that?)
- One-step sparse estimates in nonconcave penalized likelihood models
- Variable Selection for Partially Linear Models With Measurement Errors
- Model Selection and Estimation in Regression with Grouped Variables
- SCAD-penalized regression in high-dimensional partially linear models
- Additive regression and other nonparametric models
- Convex analysis approach to d. c. programming: Theory, algorithms and applications
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- \(\ell_1\)-penalized quantile regression in high-dimensional sparse models
- Estimation and variable selection for semiparametric additive partial linear models
- Quantile-adaptive model-free variable screening for high-dimensional heterogeneous data
- A selective review of group selection in high-dimensional models
- New efficient estimation and variable selection methods for semiparametric varying-coefficient partially linear models
- Title not available (Why is that?)
- Variable selection in high-dimensional quantile varying coefficient models
- Shrinkage Estimation of the Varying Coefficient Model
- Partially linear additive quantile regression in ultra-high dimension
- Variable selection in nonparametric additive models
- Linear or Nonlinear? Automatic Structure Discovery for Partially Linear Models
- Title not available (Why is that?)
- Title not available (Why is that?)
- Estimation in a semiparametric model for longitudinal data with unspecified dependence structure
- Quantile regression in partially linear varying coefficient models
- Consistent covariate selection and post model selection inference in semiparametric regression.
- Simultaneous multiple non-crossing quantile regression estimation using kernel constraints
- Model Selection via Bayesian Information Criterion for Quantile Regression Models
- Profile-kernel likelihood inference with diverging number of parameters
- Bivariate tensor-product \(B\)-splines in a partly linear model
- Estimation and variable selection for generalized additive partial linear models
- On M-processes and M-estimation
- Conditional growth charts. (With discussion and rejoinder)
- Can Tests for Jumps be Viewed as Tests for Clusters?
- Limiting behavior of \(M\)-estimators of regression coefficients in high dimensional linear models. I: Scale-dependent case. II: Scale-invariant case
- On parameters of increasing dimensions
- Regularized simultaneous model selection in multiple quantiles regression
- Semi-varying coefficient models with a diverging number of components
Cited In (46)
- High-dimensional model averaging for quantile regression
- Forward variable selection for ultra-high dimensional quantile regression models
- Estimation for partially linear additive regression with spatial data
- Functional linear quantile regression on a two-dimensional domain
- Penalized weighted composite quantile regression for partially linear varying coefficient models with missing covariates
- Bayesian reciprocal LASSO quantile regression
- Smoothed quantile regression for partially functional linear models in high dimensions
- Estimation and variable selection for partially linear additive models with measurement errors
- Data Integration in High Dimension With Multiple Quantiles
- Adaptive varying-coefficient linear quantile model: a profiled estimating equations approach
- Sequential profile Lasso for ultra-high-dimensional partially linear models
- Title not available (Why is that?)
- Additive models for extremal quantile regression with Pareto-type distributions
- Quantile regression of ultra-high dimensional partially linear varying-coefficient model with missing observations
- Locally sparse quantile estimation for a partially functional interaction model
- Adaptively weighted group Lasso for semiparametric quantile regression models
- Semiparametric efficient estimation in high-dimensional partial linear regression models
- Estimation and inference in functional varying-coefficient single-index quantile regression models
- A Review of Envelope Models
- Incorporating Graphical Structure of Predictors in Sparse Quantile Regression
- Neural Networks for Partially Linear Quantile Regression
- Variable selection for additive partial linear quantile regression with missing covariates
- Quantile partially linear additive model for data with dropouts and an application to modeling cognitive decline
- Screening and selection for quantile regression using an alternative measure of variable importance
- Evaluating Dynamic Conditional Quantile Treatment Effects with Applications in Ridesharing
- FUNCTIONAL ADDITIVE QUANTILE REGRESSION
- A robust spline approach in partially linear additive models
- On Additive Conditional Quantiles With High-Dimensional Covariates
- Profile statistical inference for partially linear additive models with a diverging number of parameters
- Predictive quantile regression with mixed roots and increasing dimensions: the ALQR approach
- Quantile forward regression for high-dimensional survival data
- A spatial panel quantile model with unobserved heterogeneity
- Model-averaging-based semiparametric modeling for conditional quantile prediction
- Robust variable selection for partially linear additive models
- Estimation and variable selection for generalized functional partially varying coefficient hybrid models
- Quantile regression for additive coefficient models in high dimensions
- Quantile Co-Movement in Financial Markets: A Panel Quantile Model With Unobserved Heterogeneity
- CONDITIONAL MARGINAL TEST FOR HIGH DIMENSIONAL QUANTILE REGRESSION
- Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models
- Penalized averaging of parametric and non-parametric quantile forecasts
- Additive partially linear models for ultra-high-dimensional regression
- Analysis of global and local optima of regularized quantile regression in high dimensions: a subgradient approach
- Partially linear additive quantile regression in ultra-high dimension
- Subgroup analysis for heterogeneous additive partially linear models and its application to car sales data
- Shrinkage estimation for identification of linear components in composite quantile additive models
- Semiparametric model averaging for ultrahigh-dimensional conditional quantile prediction
This page was built for publication: Partially linear additive quantile regression in ultra-high dimension
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5963523)
