Component selection in the additive regression model
From MaRDI portal
Publication:2852624
Abstract: Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables, which are unobservable. As such, some approximation is needed. In this paper, we suggest a combination of penalized regression spline approximation and group variable selection, called the lasso-type spline method (LSM), to handle this component selection problem with a diverging number of strongly correlated variables in each group. It is shown that the proposed method can select significant components and estimate nonparametric additive function components simultaneously with an optimal convergence rate simultaneously. To make the LSM stable in computation and able to adapt its estimators to the level of smoothness of the component functions, weighted power spline bases and projected weighted power spline bases are proposed. Their performance is examined by simulation studies across two set-ups with independent predictors and correlated predictors, respectively, and appears superior to the performance of competing methods. The proposed method is extended to a partial linear regression model analysis with real data, and gives reliable results.
Recommendations
Cites work
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- A Fully Automated Bandwidth Selection Method for Fitting Additive Models
- A group bridge approach for variable selection
- A kernel method of estimating structured nonparametric regression based on marginal integration
- A simple smooth backfitting method for additive models
- Additive regression and other nonparametric models
- Bandwidth selection for smooth backfitting in additive models
- Component selection and smoothing in multivariate nonparametric regression
- Direct estimation of low-dimensional components in additive models.
- Flexible Parsimonious Smoothing and Additive Modeling
- Fourier series approximation of separable models
- Group variable selection via a hierarchical lasso and its oracle property
- High-dimensional additive modeling
- Ideal spatial adaptation by wavelet shrinkage
- Linear smoothers and additive models
- Locally adaptive regression splines
- Nonconcave penalized likelihood with a diverging number of parameters.
- Nonparametric regression using Bayesian variable selection
- Prediction Error Estimation Under Bregman Divergence for Non‐Parametric Regression and Classification
- Profile-kernel likelihood inference with diverging number of parameters
- Smooth Backfitting in Practice
- Smooth backfitting in generalized additive models
- The dimensionality reduction principle for generalized additive models
- The existence and asymptotic properties of a backfitting projection algorithm under weak conditions
- Tuning parameter selectors for the smoothly clipped absolute deviation method
- Variable Selection and Function Estimation in Additive Nonparametric Regression Using a Data-Based Prior
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- Variable selection in nonparametric additive models
Cited in
(17)- Effect Selection and Regularization in Structured Additive Distributional Regression
- Nonparametric variable selection and its application to additive models
- Sure independence screening in ultrahigh dimensional generalized additive models
- A sequential approach to feature selection in high-dimensional additive models
- Variable selection in partially linear additive hazards model with grouped covariates and a diverging number of parameters
- Variable selection for additive model via cumulative ratios of empirical strengths total
- Feature screening in ultrahigh-dimensional additive Cox model
- Component selection in additive quantile regression models
- scientific article; zbMATH DE number 3852787 (Why is no real title available?)
- Variable Selection via Additive Conditional Independence
- Robust and efficient direction identification for groupwise additive multiple-index models and its applications
- Automatic component selection in additive modeling of French national electricity load forecasting
- Additive model selection
- A group bridge approach for component selection in nonparametric accelerated failure time additive regression model
- Detection the symmetry or asymmetry of model errors in partial linear models
- Testing symmetry of model errors for nonparametric regression models by using correlation coefficient1
- Variable selection in nonparametric additive models
This page was built for publication: Component selection in the additive regression model
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2852624)
