Automatic search intervals for the smoothing parameter in penalized splines
From MaRDI portal
(Redirected from Publication:158336)
Abstract: The selection of smoothing parameter is central to the estimation of penalized splines. The best value of the smoothing parameter is often the one that optimizes a smoothness selection criterion, such as generalized cross-validation error (GCV) and restricted likelihood (REML). To correctly identify the global optimum rather than being trapped in an undesired local optimum, grid search is recommended for optimization. Unfortunately, the grid search method requires a pre-specified search interval that contains the unknown global optimum, yet no guideline is available for providing this interval. As a result, practitioners have to find it by trial and error. To overcome such difficulty, we develop novel algorithms to automatically find this interval. Our automatic search interval has four advantages. (i) It specifies a smoothing parameter range where the associated penalized least squares problem is numerically solvable. (ii) It is criterion-independent so that different criteria, such as GCV and REML, can be explored on the same parameter range. (iii) It is sufficiently wide to contain the global optimum of any criterion, so that for example, the global minimum of GCV and the global maximum of REML can both be identified. (iv) It is computationally cheap compared with the grid search itself, carrying no extra computational burden in practice. Our method is ready to use through our recently developed R package gps (>= version 1.1). It may be embedded in more advanced statistical modeling methods that rely on penalized splines.
Recommendations
- Knot selection for least-squares and penalized splines
- Smoothing parameter selection in two frameworks for penalized splines
- Miscellanea. On the optimal amount of smoothing in penalised spline regression
- A non-iterative optimization method for smoothness in penalized spline regression
- Optimum smoothing parameter selection for penalized least squares in form of linear mixed effect models
Cites work
- scientific article; zbMATH DE number 45848 (Why is no real title available?)
- scientific article; zbMATH DE number 6734253 (Why is no real title available?)
- A functional single-index model
- A new algorithm to estimate monotone nonparametric link functions and a comparison with parametric approach
- A practical guide to splines.
- A statistical perspective on ill-posed inverse problems (with discussion)
- Additive models with autoregressive symmetric errors based on penalized regression splines
- An alternative semiparametric model for spatial panel data
- An extension of log-symmetric regression models: R codes and applications
- Asymptotic theory of penalized splines
- Estimating functional linear mixed-effects regression models
- Estimating generalized semiparametric additive models using parameter cascading
- Flexible Bayesian additive joint models with an application to type 1 diabetes research
- Flexible estimation in cure survival models using Bayesian P-splines
- Flexible smoothing with B-splines and penalties. With comments and a rejoinder by the authors
- Functional single-index quantile regression models
- Generalized additive models with flexible response functions
- Improved dynamic predictions from joint models of longitudinal and survival data with time-varying effects using P-splines
- Influence diagnostics for robust P-splines using scale mixture of normal distributions
- Linear mixed-effects modeling by parameter cascading
- Multiple smoothing parameters selection in additive regression quantiles
- Oscillation matrices with spline smoothing
- Penalised spline estimation for generalised partially linear single-index models
- Penalized spline estimation in varying coefficient models with censored data
- Practical smoothing. The joys of P-splines
- Recovering the underlying trajectory from sparse and irregular longitudinal data
- Selecting the smoothing parameter and knots for an extension of penalized splines to censored data
- Semiparametric Regression
- Smoothing by spline functions.
- Smoothing by spline functions. II
- Smoothing parameter selection for a class of semiparametric linear models
- Smoothing splines. Methods and applications
- Spatio-temporal expectile regression models
- Testing the heteroscedastic error structure in quantile varying coefficient models
This page was built for publication: Automatic search intervals for the smoothing parameter in penalized splines
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q158336)
