Adaptive functional linear regression

DOI10.1214/12-AOS1050zbMATH Open1373.62350arXiv1112.2509MaRDI QIDQ741806FDOQ741806

Authors: F. Comte, Jan Johannes 

Publication date: 15 September 2014

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We consider the estimation of the slope function in functional linear regression, where scalar responses are modeled in dependence of random functions. Cardot and Johannes [J. Multivariate Anal. 101 (2010) 395-408] have shown that a thresholded projection estimator can attain up to a constant minimax-rates of convergence in a general framework which allows us to cover the prediction problem with respect to the mean squared prediction error as well as the estimation of the slope function and its derivatives. This estimation procedure, however, requires an optimal choice of a tuning parameter with regard to certain characteristics of the slope function and the covariance operator associated with the functional regressor. As this information is usually inaccessible in practice, we investigate a fully data-driven choice of the tuning parameter which combines model selection and Lepski's method. It is inspired by the recent work of Goldenshluger and Lepski [Ann. Statist. 39 (2011) 1608-1632]. The tuning parameter is selected as minimizer of a stochastic penalized contrast function imitating Lepski's method among a random collection of admissible values. This choice of the tuning parameter depends only on the data and we show that within the general framework the resulting data-driven thresholded projection estimator can attain minimax-rates up to a constant over a variety of classes of slope functions and covariance operators. The results are illustrated considering different configurations which cover in particular the prediction problem as well as the estimation of the slope and its derivatives. A simulation study shows the reasonable performance of the fully data-driven estimation procedure.

Full work available at URL: https://arxiv.org/abs/1112.2509

Recommendations

• Adaptive estimation of linear functionals in functional linear models
• Functional Adaptive Model Estimation
• Adaptive estimation in the functional nonparametric regression model
• Non-asymptotic adaptive prediction in functional linear models
• Minimax and adaptive prediction for functional linear regression
• On adaptive estimation of linear functionals
• Adaptive estimates of linear functionals
• On adaptive linear regression
• Adaptive functional linear regression via functional principal component analysis and block thresholding

zbMATH Keywords

predictionadaptationderivative estimationLepski's methodlinear Galerkin approachminimax theorymodel selestion

Mathematics Subject Classification ID

Asymptotic properties of nonparametric inference (62G20) Nonparametric robustness (62G35) Linear regression; mixed models (62J05)

Cites Work

• Functional data analysis.
• Nonparametric functional data analysis. Theory and practice.
• Linear processes in function spaces. Theory and applications
• Functional linear model
• Title not available (Why is that?)
• New concentration inequalities in product spaces
• PLS regression on a stochastic process
• Generalized functional linear models
• Risk bounds for model selection via penalization
• A Statistical View of Some Chemometrics Regression Tools
• Title not available (Why is that?)
• Title not available (Why is that?)
• Concentration inequalities and model selection. Ecole d'Eté de Probabilités de Saint-Flour XXXIII -- 2003.
• Title not available (Why is that?)
• Beiträge zur Störungstheorie der Spektralzerlegung
• Bandwidth selection in kernel density estimation: oracle inequalities and adaptive minimax optimality
• Concentration around the mean for maxima of empirical processes
• Methodology and convergence rates for functional linear regression
• Title not available (Why is that?)
• Let's Get Real: A Factor Analytical Approach to Disaggregated Business Cycle Dynamics
• CLT in functional linear regression models
• Smoothing splines estimators for functional linear regression
• Nonlinear estimation for linear inverse problems with error in the operator
• On inverse problems with unknown operators
• Penalized contrast estimator for adaptive density deconvolution
• Sharp Optimality in Density Deconvolution with Dominating Bias. I
• Sharp Optimality in Density Deconvolution with Dominating Bias. II
• When Do Sobolev Spaces Form a Hilbert Scale?
• Thresholding projection estimators in functional linear models
• On rate optimal local estimation in functional linear regression
• Adaptive estimation in circular functional linear models
• Optimal prediction for linear regression with infinitely many parameters.
• Error bounds for tikhonov regularization in hilbert scales
• Adaptive prediction and estimation in linear regression with infinitely many parameters.
• High-dimensional Gaussian model selection on a Gaussian design

Cited In (26)

• On adaptive linear regression
• On estimation in a spatial functional linear regression model with derivatives
• Faster convergence rate for functional linear regression in reproducing kernel Hilbert spaces
• On rate optimal local estimation in functional linear regression
• Estimation and testing for partially functional linear errors-in-variables models
• Hybrid regularisation and the (in)admissibility of ridge regression in infinite dimensional Hilbert spaces
• Adaptive and minimax estimation of the cumulative distribution function given a functional covariate
• Optimal adaptive estimation of the relative density
• Robust shrinkage estimation and selection for functional multiple linear model through LAD loss
• Adaptive estimation in circular functional linear models
• Adaptive functional linear regression via functional principal component analysis and block thresholding
• Non-asymptotic adaptive prediction in functional linear models
• Estimation on semi-functional linear errors-in-variables models
• On estimation and prediction in spatial functional linear regression model
• Adaptive estimation of linear functionals in functional linear models
• Functional linear regression with functional response
• Optimal eigen expansions and uniform bounds
• Minimax adaptive tests for the functional linear model
• Lasso in Infinite dimension: application to variable selection in functional multivariate linear regression
• PCA-based estimation for functional linear regression with functional responses
• On the effect of noisy measurements of the regressor in functional linear models
• Functional linear regression with points of impact
• Nonparametric estimation in a mixed-effect Ornstein-Uhlenbeck model
• Thresholding projection estimators in functional linear models
• An introduction to nonparametric adaptive estimation
• Estimation in functional lagged regression

Uses Software

• fda (R)

This page was built for publication: Adaptive functional linear regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q741806)