Smoothing splines estimators for functional linear regression

DOI10.1214/07-AOS563zbMATH Open1169.62027arXiv0902.4344MaRDI QIDQ1002148FDOQ1002148

Alois Kneip, Christophe Crambes, Pascal Sarda

Publication date: 25 February 2009

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: The paper considers functional linear regression, where scalar responses $Y_1,\mathrm{...},Y_n$ are modeled in dependence of random functions $X_1,\mathrm{...},X_n$. We propose a smoothing splines estimator for the functional slope parameter based on a slight modification of the usual penalty. Theoretical analysis concentrates on the error in an out-of-sample prediction of the response for a new random function $X_{n+1}$. It is shown that rates of convergence of the prediction error depend on the smoothness of the slope function and on the structure of the predictors. We then prove that these rates are optimal in the sense that they are minimax over large classes of possible slope functions and distributions of the predictive curves. For the case of models with errors-in-variables the smoothing spline estimator is modified by using a denoising correction of the covariance matrix of discretized curves. The methodology is then applied to a real case study where the aim is to predict the maximum of the concentration of ozone by using the curve of this concentration measured the preceding day.

Full work available at URL: https://arxiv.org/abs/0902.4344

Recommendations

• Prediction in functional linear regression
• scientific article; zbMATH DE number 2015204
• Smoothing splines estimators in functional linear regression with errors-in-variables
• Linear Regression Models for Functional Data
• A reproducing kernel Hilbert space approach to functional linear regression

zbMATH Keywords

functional linear regressionsmoothing splinesfunctional parameterfunctional variable

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Linear regression; mixed models (62J05) Inference from stochastic processes and prediction (62M20)

Cites Work

• Title not available (Why is that?)
• Flexible smoothing with \(B\)-splines and penalties. With comments and a rejoinder by the authors
• Functional data analysis.
• Nonparametric functional data analysis. Theory and practice.
• Functional Data Analysis for Sparse Longitudinal Data
• Linear processes in function spaces. Theory and applications
• Applied functional data analysis. Methods and case studies
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Functional Quasi-Likelihood Regression Models with Smooth Random Effects
• Linear functional regression: The case of fixed design and functional response
• Optimal global rates of convergence for nonparametric regression
• Generalized functional linear models
• Prediction in functional linear regression
• Title not available (Why is that?)
• An Analysis of the Total Least Squares Problem
• Title not available (Why is that?)
• Residual variance and residual pattern in nonlinear regression
• On rates of convergence in functional linear regression
• Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy
• Methodology and convergence rates for functional linear regression
• CLT in functional linear regression models
• Ordered linear smoothers
• Smoothing splines estimators in functional linear regression with errors-in-variables
• Natural spline functions, their associated eigenvalue problem
• Nonparametric estimation of smoothed principal components analysis of sampled noisy functions
• The Componentwise Distance to the Nearest Singular Matrix

Cited In (only showing first 100 items - show all)

• Functional Finite Mixture Regression Models
• Prediction in functional regression with discretely observed and noisy covariates
• Robust exponential squared loss-based estimation in semi-functional linear regression models
• Faster convergence rate for functional linear regression in reproducing kernel Hilbert spaces
• Estimation in functional single-index varying coefficient model
• Methods for Scalar‐on‐Function Regression
• Data depth for measurable noisy random functions
• Estimation and testing for partially functional linear errors-in-variables models
• Robust estimation for a general functional single index model via quantile regression
• Robust estimation with a modified Huber's loss for partial functional linear models based on splines
• Robust estimation for partial functional linear regression models based on FPCA and weighted composite quantile regression
• Robust estimation for partial functional linear regression model based on modal regression
• Hybrid regularisation and the (in)admissibility of ridge regression in infinite dimensional Hilbert spaces
• Regularised forecasting via smooth-rough partitioning of the regression coefficients
• Robust estimation with modified Huber's function for functional linear models
• Penalized contrast estimation in functional linear models with circular data
• Étude asymptotique d'un estimateur spline hybride pour le modèle linéaire fonctionnel
• Variable selection for functional linear models with strong heredity constraint
• Testing for lack-of-fit in functional regression models against general alternatives
• Optimal prediction for high-dimensional functional quantile regression in reproducing kernel Hilbert spaces
• Functional Linear Regression Analysis Based on Partial Least Squares and Its Application
• Rank method for partial functional linear regression models
• Testing linearity in partial functional linear quantile regression model based on regression rank scores
• Partially functional linear regression in reproducing kernel Hilbert spaces
• Stochastic functional linear models and Malliavin calculus
• Estimation on semi-functional linear errors-in-variables models
• Integrated Estimation of Functional-Coefficient Regression Models with Different Smoothing Variables
• FPCA-based estimation for generalized functional partially linear models
• Checking the adequacy of functional linear quantile regression model
• Improving Estimation in Functional Linear Regression With Points of Impact: Insights Into Google AdWords
• Estimation in functional linear quantile regression
• Estimation for generalized partially functional linear additive regression model
• Functional Regression for Densely Observed Data With Novel Regularization
• A robust spatial autoregressive scalar-on-function regression with \(t\)-distribution
• Additive functional regression in reproducing kernel Hilbert spaces under smoothness condition
• A Note on Estimation in Hilbertian Linear Models
• A comparison of testing methods in scalar-on-function regression
• Reduced rank modeling for functional regression with functional responses
• Partially functional linear varying coefficient model
• Gaussian Process Models for Non Parametric Functional Regression with Functional Responses
• Single-index partially functional linear regression model
• Partial functional linear quantile regression
• Regression imputation in the functional linear model with missing values in the response
• PCA-based estimation for functional linear regression with functional responses
• Statistical inference in functional semiparametric spatial autoregressive model
• Generalized signed-rank estimation and selection for the functional linear model
• The theory and application of penalized methods or reproducing kernel Hilbert spaces made easy
• No effect tests in regression on functional variable and some applications to spectrometric studies
• Rank-based test for partial functional linear regression models
• Adaptive Global Testing for Functional Linear Models
• Varying-coefficient partially functional linear quantile regression models
• Adaptive regression with Brownian path covariate
• Smoothly adaptively centered ridge estimator
• Functional linear model with partially observed covariate and missing values in the response
• On asymptotic distribution of prediction in functional linear regression
• Testing independence and goodness-of-fit jointly for functional linear models
• Series expansion for functional sufficient dimension reduction
• Estimation of the Sobol indices in a linear functional multidimensional model
• Robust functional linear regression based on splines
• On rate optimal local estimation in functional linear regression
• Asymptotic equivalence of functional linear regression and a white noise inverse problem
• Single and multiple index functional regression models with nonparametric link
• Regression when both response and predictor are functions
• Title not available (Why is that?)
• Adaptive and minimax estimation of the cumulative distribution function given a functional covariate
• \(L_1\)-penalization in functional linear regression with subgaussian design
• Robust functional regression based on principal components
• Estimating functional linear mixed-effects regression models
• A reproducing kernel Hilbert space approach to functional linear regression
• Heterogeneous Spatial Dynamical Regression in a Hilbert-Valued Context
• Structural test in regression on functional variables
• Local linear regression for functional data
• Adaptive estimation in circular functional linear models
• Functional linear regression after spline transformation
• Electricity consumption prediction with functional linear regression using spline estimators
• Nonparametric inference in generalized functional linear models
• Goodness-of-fit Tests for Functional Linear Models Based on Integrated Projections
• Deciding the dimension of effective dimension reduction space for functional and high-dimension\-al data
• Non-asymptotic adaptive prediction in functional linear models
• Title not available (Why is that?)
• M-estimation for functional linear regression
• Optimal estimation for the functional Cox model
• Recursive estimation of nonparametric regression with functional covariate
• A note on generalized functional linear model and its application
• Linear prediction in functional data analysis
• A class of functional partially linear single-index models
• Linear mixed function‐on‐function regression models
• On estimation and prediction in spatial functional linear regression model
• Polynomial spline estimation for partial functional linear regression models
• A randomness test for functional panels
• Robust penalized estimators for functional linear regression
• Spline estimators for semi-functional linear model
• Spline estimation of conditional quantities for functional covariates
• Adaptive estimation of linear functionals in functional linear models
• Lower bound in regression for functional data by representation of small ball probabilities
• Functional linear regression with functional response
• Sieve M-estimator for a semi-functional linear model
• On prediction error in functional linear regression
• Smoothing splines estimators in functional linear regression with errors-in-variables
• Optimal prediction of quantile functional linear regression in reproducing kernel Hilbert spaces

Uses Software

• fda (R)
• VanHuffel

This page was built for publication: Smoothing splines estimators for functional linear regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1002148)