Smoothing splines estimators for functional linear regression

DOI10.1214/07-AOS563zbMATH Open1169.62027arXiv0902.4344MaRDI QIDQ1002148FDOQ1002148

Authors: Christophe Crambes, Alois Kneip, Pascal Sarda 

Publication date: 25 February 2009

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: The paper considers functional linear regression, where scalar responses $Y_1,\mathrm{...},Y_n$ are modeled in dependence of random functions $X_1,\mathrm{...},X_n$. We propose a smoothing splines estimator for the functional slope parameter based on a slight modification of the usual penalty. Theoretical analysis concentrates on the error in an out-of-sample prediction of the response for a new random function $X_{n+1}$. It is shown that rates of convergence of the prediction error depend on the smoothness of the slope function and on the structure of the predictors. We then prove that these rates are optimal in the sense that they are minimax over large classes of possible slope functions and distributions of the predictive curves. For the case of models with errors-in-variables the smoothing spline estimator is modified by using a denoising correction of the covariance matrix of discretized curves. The methodology is then applied to a real case study where the aim is to predict the maximum of the concentration of ozone by using the curve of this concentration measured the preceding day.

Full work available at URL: https://arxiv.org/abs/0902.4344

Recommendations

• Prediction in functional linear regression
• scientific article; zbMATH DE number 2015204
• Smoothing splines estimators in functional linear regression with errors-in-variables
• Linear Regression Models for Functional Data
• A reproducing kernel Hilbert space approach to functional linear regression

zbMATH Keywords

functional linear regressionsmoothing splinesfunctional parameterfunctional variable

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Linear regression; mixed models (62J05) Inference from stochastic processes and prediction (62M20)

Cites Work

• Title not available (Why is that?)
• Flexible smoothing with \(B\)-splines and penalties. With comments and a rejoinder by the authors
• Functional data analysis.
• Nonparametric functional data analysis. Theory and practice.
• Functional Data Analysis for Sparse Longitudinal Data
• Linear processes in function spaces. Theory and applications
• Applied functional data analysis. Methods and case studies
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Functional Quasi-Likelihood Regression Models with Smooth Random Effects
• Linear functional regression: The case of fixed design and functional response
• Optimal global rates of convergence for nonparametric regression
• Generalized functional linear models
• Prediction in functional linear regression
• Title not available (Why is that?)
• An Analysis of the Total Least Squares Problem
• Title not available (Why is that?)
• Residual variance and residual pattern in nonlinear regression
• On rates of convergence in functional linear regression
• Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy
• Methodology and convergence rates for functional linear regression
• CLT in functional linear regression models
• Ordered linear smoothers
• Smoothing splines estimators in functional linear regression with errors-in-variables
• Natural spline functions, their associated eigenvalue problem
• Nonparametric estimation of smoothed principal components analysis of sampled noisy functions
• The Componentwise Distance to the Nearest Singular Matrix

Cited In (only showing first 100 items - show all)

• Series expansion for functional sufficient dimension reduction
• Estimation of the Sobol indices in a linear functional multidimensional model
• Robust functional linear regression based on splines
• On rate optimal local estimation in functional linear regression
• Asymptotic equivalence of functional linear regression and a white noise inverse problem
• Single and multiple index functional regression models with nonparametric link
• Regression when both response and predictor are functions
• Title not available (Why is that?)
• Adaptive and minimax estimation of the cumulative distribution function given a functional covariate
• \(L_1\)-penalization in functional linear regression with subgaussian design
• Robust functional regression based on principal components
• Estimating functional linear mixed-effects regression models
• A reproducing kernel Hilbert space approach to functional linear regression
• Heterogeneous Spatial Dynamical Regression in a Hilbert-Valued Context
• Structural test in regression on functional variables
• Local linear regression for functional data
• Adaptive estimation in circular functional linear models
• Functional linear regression after spline transformation
• Electricity consumption prediction with functional linear regression using spline estimators
• Nonparametric inference in generalized functional linear models
• Goodness-of-fit Tests for Functional Linear Models Based on Integrated Projections
• Deciding the dimension of effective dimension reduction space for functional and high-dimension\-al data
• Non-asymptotic adaptive prediction in functional linear models
• Title not available (Why is that?)
• M-estimation for functional linear regression
• Optimal estimation for the functional Cox model
• Recursive estimation of nonparametric regression with functional covariate
• A note on generalized functional linear model and its application
• Linear prediction in functional data analysis
• A class of functional partially linear single-index models
• Linear mixed function‐on‐function regression models
• On estimation and prediction in spatial functional linear regression model
• Polynomial spline estimation for partial functional linear regression models
• A randomness test for functional panels
• On the validity of the bootstrap in non-parametric functional regression
• Robust penalized estimators for functional linear regression
• Spline estimators for semi-functional linear model
• Spline estimation of conditional quantities for functional covariates
• Adaptive estimation of linear functionals in functional linear models
• Lower bound in regression for functional data by representation of small ball probabilities
• Functional linear regression with functional response
• Sieve M-estimator for a semi-functional linear model
• On prediction error in functional linear regression
• Smoothing splines estimators in functional linear regression with errors-in-variables
• Optimal prediction of quantile functional linear regression in reproducing kernel Hilbert spaces
• Partial functional linear regression
• Response-Adaptive Regression for Longitudinal Data
• Functional projection pursuit regression
• Asymptotics of prediction in functional linear regression with functional outputs
• Estimation in Functional Lagged Regression
• Minimax adaptive tests for the functional linear model
• Lasso in Infinite dimension: application to variable selection in functional multivariate linear regression
• A partial overview of the theory of statistics with functional data
• Title not available (Why is that?)
• Adaptive functional linear regression
• On prediction rate in partial functional linear regression
• Minimax prediction for functional linear regression with functional responses in reproducing kernel Hilbert spaces
• Factor models and variable selection in high-dimensional regression analysis
• Functional partial linear model
• On the effect of noisy measurements of the regressor in functional linear models
• Bivariate splines for spatial functional regression models
• Functional linear regression with points of impact
• A test of linearity in partial functional linear regression
• High-Dimensional Spatial Quantile Function-on-Scalar Regression
• Estimation for semi-functional linear regression
• Convergence of nonparametric functional regression estimates with functional responses
• Curse of dimensionality and related issues in nonparametric functional regression
• Functional Principal Component Regression and Functional Partial Least‐squares Regression: An Overview and a Comparative Study
• Structural tests in regression on functional variables
• Estimation in functional regression for general exponential families
• Thresholding projection estimators in functional linear models
• Robust optimal estimation of location from discretely sampled functional data
• Consistency of the recursive nonparametric regression estimation for dependent functional data
• Prediction in functional linear regression
• The M-estimator for functional linear regression model
• Functional Finite Mixture Regression Models
• Prediction in functional regression with discretely observed and noisy covariates
• Robust exponential squared loss-based estimation in semi-functional linear regression models
• Faster convergence rate for functional linear regression in reproducing kernel Hilbert spaces
• Estimation in functional single-index varying coefficient model
• Methods for Scalar‐on‐Function Regression
• Data depth for measurable noisy random functions
• Estimation and testing for partially functional linear errors-in-variables models
• Robust estimation for a general functional single index model via quantile regression
• Robust estimation with a modified Huber's loss for partial functional linear models based on splines
• Robust estimation for partial functional linear regression models based on FPCA and weighted composite quantile regression
• Robust estimation for partial functional linear regression model based on modal regression
• Hybrid regularisation and the (in)admissibility of ridge regression in infinite dimensional Hilbert spaces
• Regularised forecasting via smooth-rough partitioning of the regression coefficients
• Robust estimation with modified Huber's function for functional linear models
• Penalized contrast estimation in functional linear models with circular data
• Étude asymptotique d'un estimateur spline hybride pour le modèle linéaire fonctionnel
• Variable selection for functional linear models with strong heredity constraint
• Testing for lack-of-fit in functional regression models against general alternatives
• Optimal prediction for high-dimensional functional quantile regression in reproducing kernel Hilbert spaces
• Functional Linear Regression Analysis Based on Partial Least Squares and Its Application
• Rank method for partial functional linear regression models
• Testing linearity in partial functional linear quantile regression model based on regression rank scores
• Partially functional linear regression in reproducing kernel Hilbert spaces
• Stochastic functional linear models and Malliavin calculus

Uses Software

• fda (R)
• VanHuffel

This page was built for publication: Smoothing splines estimators for functional linear regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1002148)