Identifiability in penalized function-on-function regression models
From MaRDI portal
Abstract: Regression models with functional responses and covariates constitute a powerful and increasingly important model class. However, regression with functional data poses well known and challenging problems of non-identifiability. This non-identifiability can manifest itself in arbitrarily large errors for coefficient surface estimates despite accurate predictions of the responses, thus invalidating substantial interpretations of the fitted models. We offer an accessible rephrasing of these identifiability issues in realistic applications of penalized linear function-on-function-regression and delimit the set of circumstances under which they are likely to occur in practice. Specifically, non-identifiability that persists under smoothness assumptions on the coefficient surface can occur if the functional covariate's empirical covariance has a kernel which overlaps that of the roughness penalty of the spline estimator. Extensive simulation studies validate the theoretical insights, explore the extent of the problem and allow us to evaluate their practical consequences under varying assumptions about the data generating processes. A case study illustrates the practical significance of the problem. Based on theoretical considerations and our empirical evaluation, we provide immediately applicable diagnostics for lack of identifiability and give recommendations for avoiding estimation artifacts in practice.
Recommendations
- Penalized function-on-function regression
- scientific article; zbMATH DE number 962363
- Penalized likelihood functional regression
- Penalized solutions to functional regression problems
- Penalized Estimating Functions and Variable Selection in Semiparametric Regression Models
- Penalized spline estimation for functional coefficient regression models
- Robust penalized estimators for functional linear regression
- Estimation in generalized linear models for functional data via penalized likelihood
- Identification and estimation by penalization in nonparametric instrumental regression
Cites work
- A distance measure between cointegration spaces
- Functional Adaptive Model Estimation
- Functional data analysis.
- Functional linear model
- Functional linear regression analysis for longitudinal data
- Functional Principal Component Regression and Functional Partial Least Squares
- Functional quadratic regression
- Generalized Linear Models with Functional Predictors
- Generalized multilevel functional regression
- scientific article; zbMATH DE number 1077338 (Why is no real title available?)
- scientific article; zbMATH DE number 2015204 (Why is no real title available?)
- scientific article; zbMATH DE number 2222292 (Why is no real title available?)
- Low‐Rank Scale‐Invariant Tensor Product Smooths for Generalized Additive Mixed Models
- Penalized function-on-function regression
- Practical variable selection for generalized additive models
- Varying-coefficient functional linear regression
Cited in
(25)- Robust depth-based estimation of the functional autoregressive model
- Boosting flexible functional regression models with a high number of functional historical effects
- Bayesian wavelet-packet historical functional linear models
- A partial least squares approach for function-on-function interaction regression
- Statistical inference for the slope parameter in functional linear regression
- Smooth LASSO estimator for the function-on-function linear regression model
- Bayesian function-on-function regression for multilevel functional data
- Optimal Penalized Function-on-Function Regression Under a Reproducing Kernel Hilbert Space Framework
- Spike-and-slab priors for function selection in structured additive regression models
- Functional Regression for Densely Observed Data With Novel Regularization
- Variable Selection for Multiple Function-on-Function Linear Regression
- A general framework for functional regression modelling
- On the estimation of functional random effects
- Comparison and contrast of two general functional regression modelling frameworks
- Latent group detection in functional partially linear regression models
- Adaptive smoothing spline estimator for the function-on-function linear regression model
- Envelope Model for Function-on-Function Linear Regression
- Statistical inference for function-on-function linear regression
- Estimation and inference for functional linear regression models with partially varying regression coefficients
- Sparse functional linear models via calibrated concave-convex procedure
- Comments on: ``Shape-based functional data analysis
- Advances in estimation and inference for historical functional linear models
- Functional time transformation model with applications to digital health
- The impact of model assumptions in scalar-on-image regression
- Statistical inference in functional quadratic expectile regression model
This page was built for publication: Identifiability in penalized function-on-function regression models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q259185)