Component selection in the additive regression model
From MaRDI portal
Abstract: Similar to variable selection in the linear regression model, selecting significant components in the popular additive regression model is of great interest. However, such components are unknown smooth functions of independent variables, which are unobservable. As such, some approximation is needed. In this paper, we suggest a combination of penalized regression spline approximation and group variable selection, called the lasso-type spline method (LSM), to handle this component selection problem with a diverging number of strongly correlated variables in each group. It is shown that the proposed method can select significant components and estimate nonparametric additive function components simultaneously with an optimal convergence rate simultaneously. To make the LSM stable in computation and able to adapt its estimators to the level of smoothness of the component functions, weighted power spline bases and projected weighted power spline bases are proposed. Their performance is examined by simulation studies across two set-ups with independent predictors and correlated predictors, respectively, and appears superior to the performance of competing methods. The proposed method is extended to a partial linear regression model analysis with real data, and gives reliable results.
Recommendations
Cites work
- A Fully Automated Bandwidth Selection Method for Fitting Additive Models
- A group bridge approach for variable selection
- A kernel method of estimating structured nonparametric regression based on marginal integration
- A simple smooth backfitting method for additive models
- Additive regression and other nonparametric models
- Bandwidth selection for smooth backfitting in additive models
- Component selection and smoothing in multivariate nonparametric regression
- Direct estimation of low-dimensional components in additive models.
- Flexible Parsimonious Smoothing and Additive Modeling
- Fourier series approximation of separable models
- Group variable selection via a hierarchical lasso and its oracle property
- High-dimensional additive modeling
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- Ideal spatial adaptation by wavelet shrinkage
- Linear smoothers and additive models
- Locally adaptive regression splines
- Nonconcave penalized likelihood with a diverging number of parameters.
- Nonparametric regression using Bayesian variable selection
- Prediction Error Estimation Under Bregman Divergence for Non‐Parametric Regression and Classification
- Profile-kernel likelihood inference with diverging number of parameters
- Smooth backfitting in generalized additive models
- Smooth Backfitting in Practice
- The dimensionality reduction principle for generalized additive models
- The existence and asymptotic properties of a backfitting projection algorithm under weak conditions
- Tuning parameter selectors for the smoothly clipped absolute deviation method
- Variable Selection and Function Estimation in Additive Nonparametric Regression Using a Data-Based Prior
- Variable selection in nonparametric additive models
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(21)- Variable selection in partially linear additive hazards model with grouped covariates and a diverging number of parameters
- Nonparametric variable selection and its application to additive models
- A sequential approach to feature selection in high-dimensional additive models
- Sure independence screening in ultrahigh dimensional generalized additive models
- Robust and efficient direction identification for groupwise additive multiple-index models and its applications
- Variable selection for additive model via cumulative ratios of empirical strengths total
- scientific article; zbMATH DE number 3852787 (Why is no real title available?)
- Component selection in additive quantile regression models
- Feature screening in ultrahigh-dimensional additive Cox model
- A group bridge approach for component selection in nonparametric accelerated failure time additive regression model
- Effect Selection and Regularization in Structured Additive Distributional Regression
- Testing symmetry of model errors for nonparametric regression models by using correlation coefficient1
- Detection the symmetry or asymmetry of model errors in partial linear models
- Additive model selection
- Automatic component selection in additive modeling of French national electricity load forecasting
- Variable Selection via Additive Conditional Independence
- Additive model building for spatial regression
- Simultaneous selection of knots and variables in additive models
- Projection tests for regression coefficients in high-dimensional partial linear models
- Variable selection via non-convex group penalization for high-dimensional nonparametric additive panel data models with fixed effects
- Variable selection in nonparametric additive models
This page was built for publication: Component selection in the additive regression model
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2852624)
