Automatic search intervals for the smoothing parameter in penalized splines
From MaRDI portal
Publication:158336
DOI10.1007/S11222-022-10178-ZzbMATH Open1499.62024arXiv2205.15157OpenAlexW4309490864MaRDI QIDQ158336FDOQ158336
Zheyuan Li, Zheyuan Li, Jiguo Cao
Publication date: 18 November 2022
Published in: Statistics and Computing (Search for Journal in Brave)
Abstract: The selection of smoothing parameter is central to the estimation of penalized splines. The best value of the smoothing parameter is often the one that optimizes a smoothness selection criterion, such as generalized cross-validation error (GCV) and restricted likelihood (REML). To correctly identify the global optimum rather than being trapped in an undesired local optimum, grid search is recommended for optimization. Unfortunately, the grid search method requires a pre-specified search interval that contains the unknown global optimum, yet no guideline is available for providing this interval. As a result, practitioners have to find it by trial and error. To overcome such difficulty, we develop novel algorithms to automatically find this interval. Our automatic search interval has four advantages. (i) It specifies a smoothing parameter range where the associated penalized least squares problem is numerically solvable. (ii) It is criterion-independent so that different criteria, such as GCV and REML, can be explored on the same parameter range. (iii) It is sufficiently wide to contain the global optimum of any criterion, so that for example, the global minimum of GCV and the global maximum of REML can both be identified. (iv) It is computationally cheap compared with the grid search itself, carrying no extra computational burden in practice. Our method is ready to use through our recently developed R package gps (>= version 1.1). It may be embedded in more advanced statistical modeling methods that rely on penalized splines.
Full work available at URL: https://arxiv.org/abs/2205.15157
Recommendations
- Knot selection for least-squares and penalized splines
- Smoothing parameter selection in two frameworks for penalized splines
- Miscellanea. On the optimal amount of smoothing in penalised spline regression
- A non-iterative optimization method for smoothness in penalized spline regression
- Optimum smoothing parameter selection for penalized least squares in form of linear mixed effect models
Computational methods for problems pertaining to statistics (62-08) Nonparametric regression and quantile regression (62G08) Numerical computation using splines (65D07)
Cites Work
- Semiparametric Regression
- Flexible Bayesian additive joint models with an application to type 1 diabetes research
- Flexible smoothing with \(B\)-splines and penalties. With comments and a rejoinder by the authors
- Smoothing Splines
- Title not available (Why is that?)
- A practical guide to splines.
- An alternative semiparametric model for spatial panel data
- Penalised spline estimation for generalised partially linear single-index models
- Flexible estimation in cure survival models using Bayesian P-splines
- Title not available (Why is that?)
- Smoothing parameter selection for a class of semiparametric linear models
- Asymptotic theory of penalized splines
- Generalized additive models with flexible response functions
- Oscillation matrices with spline smoothing
- A new algorithm to estimate monotone nonparametric link functions and a comparison with parametric approach
- Estimating functional linear mixed-effects regression models
- Additive models with autoregressive symmetric errors based on penalized regression splines
- Functional single-index quantile regression models
- Penalized spline estimation in varying coefficient models with censored data
- Smoothing by spline functions.
- Influence diagnostics for robust P-splines using scale mixture of normal distributions
- Improved dynamic predictions from joint models of longitudinal and survival data with time-varying effects using P-splines
- Selecting the smoothing parameter and knots for an extension of penalized splines to censored data
- Smoothing by spline functions. II
- Testing the heteroscedastic error structure in quantile varying coefficient models
- Spatio-temporal expectile regression models
- Multiple smoothing parameters selection in additive regression quantiles
- Recovering the underlying trajectory from sparse and irregular longitudinal data
- Practical Smoothing
- A Functional Single Index Model
- An extension of log-symmetric regression models: R codes and applications
- Linear Mixed-Effects Modeling by Parameter Cascading
- A statistical perspective on ill-posed inverse problems (with discussion)
- Estimating generalized semiparametric additive models using parameter cascading
Cited In (2)
Uses Software
This page was built for publication: Automatic search intervals for the smoothing parameter in penalized splines
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q158336)
