Methodology and convergence rates for functional linear regression

DOI10.1214/009053606000000957zbMATH Open1114.62048arXiv0708.0466OpenAlexW3101449523MaRDI QIDQ997371FDOQ997371

Authors: Joel Horowitz, Peter Hall 

Publication date: 23 July 2007

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: In functional linear regression, the slope ``parameter is a function. Therefore, in a nonparametric context, it is determined by an infinite number of unknowns. Its estimation involves solving an ill-posed problem and has points of contact with a range of methodologies, including statistical smoothing and deconvolution. The standard approach to estimating the slope function is based explicitly on functional principal components analysis and, consequently, on spectral decomposition in terms of eigenvalues and eigenfunctions. We discuss this approach in detail and show that in certain circumstances, optimal convergence rates are achieved by the PCA technique. An alternative approach based on quadratic regularisation is suggested and shown to have advantages from some points of view.

Full work available at URL: https://arxiv.org/abs/0708.0466

Recommendations

• Prediction in functional linear regression
• On rates of convergence in functional linear regression
• Functional regression with repeated eigenvalues
• A reproducing kernel Hilbert space approach to functional linear regression
• On rate optimal local estimation in functional linear regression

zbMATH Keywords

dimension reductionsmoothingminimax optimalitynonparametricdeconvolutionprincipal components analysiseigenfunctioneigenvaluelinear operatorquadratic regularisation

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Factor analysis and principal components; correspondence analysis (62H25) Linear regression; mixed models (62J05)

Cites Work

• Functional data analysis
• Applied functional data analysis. Methods and case studies
• Nonlinear solution of linear inverse problems by wavelet-vaguelette decomposition
• Nonparametric Regression Analysis of Longitudinal Data
• Functional Quasi-Likelihood Regression Models with Smooth Random Effects
• Linear functional regression: The case of fixed design and functional response
• Nonparametric Estimation of Triangular Simultaneous Equations Models
• Nonparametric instrumental regression
• Instrumental Variable Estimation of Nonparametric Models
• Deconvolving kernel density estimators
• Estimation of Integrated Squared Density Derivatives from a Contaminated Sample
• On the optimal rates of convergence for nonparametric deconvolution problems
• Title not available (Why is that?)
• Oracle inequalities for inverse problems
• Adaptively local one-dimensional subproblems with application to a deconvolution problem
• Dimension fractale et estimation de la régression dans des espaces vectoriels semi-normés
• Nonparametric methods for inference in the presence of instrumental variables
• Title not available (Why is that?)
• Perturbation of spectral subspaces and solution of linear operator equations
• On inverse problems with unknown operators
• Semiparametric Estimation of Regression Models for Panel Data
• Robust estimation of generalized linear models with measurement errors.
• Tikhonov regularisation for non-linear ill-posed problems: optimal convergence rates and finite-dimensional approximation
• Error bounds for tikhonov regularization in hilbert scales
• Asymptotic minimax rates for abstract linear estimators

Cited In (only showing first 100 items - show all)

• Convergence rates of support vector machines regression for functional data
• Functional Finite Mixture Regression Models
• Partially Functional Linear Quantile Regression With Measurement Errors
• Faster convergence rate for functional linear regression in reproducing kernel Hilbert spaces
• Functional linear models for interval-valued data
• Recursive non-parametric kernel classification rule estimation for independent functional data
• Smooth LASSO estimator for the function-on-function linear regression model
• Estimation and testing for partially functional linear errors-in-variables models
• Two-time-scale nonparametric recursive regression estimator for independent functional data
• Relative perturbation bounds with applications to empirical covariance operators
• Model detection for functional polynomial regression
• Robust estimation with modified Huber's function for functional linear models
• On functional data analysis and related topics
• Adaptive global testing for functional linear models
• Statistical inference for the slope parameter in functional linear regression
• Functional feature construction for individualized treatment regimes
• Gaussian process models for non parametric functional regression with functional responses
• Ridge regression for the functional concurrent model
• Mixture inner product spaces and their application to functional data analysis
• Robust shrinkage estimation and selection for functional multiple linear model through LAD loss
• Function-on-function quadratic regression models
• Bayesian robust estimation of partially functional linear regression models using heavy-tailed distributions
• Testing for lack-of-fit in functional regression models against general alternatives
• Regression operator estimation by delta-sequences method for functional data and its applications
• Bayesian estimation of the functional spatial lag model
• Recursive nonparametric regression estimation for dependent strong mixing functional data
• FLCRM: functional linear Cox regression model
• Quantile estimation for a hybrid model of functional and varying coefficient regressions
• FPCA-based estimation for generalized functional partially linear models
• A robust spatial autoregressive scalar-on-function regression with \(t\)-distribution
• Additive functional regression in reproducing kernel Hilbert spaces under smoothness condition
• Lower bounds for invariant statistical models with applications to principal component analysis
• Network representation using graph root distributions
• Sensible functional linear discriminant analysis
• The hybrid method of FSIR and FSAVE for functional effective dimension reduction
• Minimax rate for optimal transport regression between distributions
• A comparison of testing methods in scalar-on-function regression
• Reduced rank modeling for functional regression with functional responses
• Functional linear regression analysis based on partial least squares and its application
• Two-sample functional linear models with functional responses
• Estimation and inference in partially functional linear regression with multiple functional covariates
• Nonlinear functional canonical correlation analysis via distance covariance
• PCA-based estimation for functional linear regression with functional responses
• Generalized signed-rank estimation and selection for the functional linear model
• Testing for error correlation in partially functional linear regression models
• Statistical inference of varying-coefficient partial functional spatial autoregressive model
• Sparse Functional Principal Component Analysis in High Dimensions
• Modeling and forecasting daily electricity load curves: a hybrid approach
• A flexible spatial autoregressive modelling framework for mixed covariates of multiple data types
• Functional linear model with partially observed covariate and missing values in the response
• Resampling techniques for estimating the distribution of descriptive statistics of functional data
• Functional Time Series Prediction Under Partial Observation of the Future Curve
• Series expansion for functional sufficient dimension reduction
• Estimation of the Sobol indices in a linear functional multidimensional model
• Wasserstein Regression
• A note on functional linear regression
• On rate optimal local estimation in functional linear regression
• Measures of influence for the functional linear model with scalar response
• A survey of functional principal component analysis
• A note on the prediction error of principal component regression in high dimensions
• Recent advances in functional data analysis and high-dimensional statistics
• The spatial sign covariance operator: asymptotic results and applications
• Interpretable dimension reduction for classifying functional data
• Estimation, imputation and prediction for the functional linear model with scalar response with responses missing at random
• Asymptotic equivalence of functional linear regression and a white noise inverse problem
• Varying-coefficient functional linear regression
• Multivariate functional principal component analysis for data observed on different (dimensional) domains
• \(L_1\)-penalization in functional linear regression with subgaussian design
• Robust functional regression based on principal components
• Functional linear regression with truncated signatures
• Optimal classification and nonparametric regression for functional data
• A reproducing kernel Hilbert space approach to functional linear regression
• Adaptive estimation in circular functional linear models
• Nonlinear manifold representations for functional data
• Forecasting functional time series
• Nonparametric inference in generalized functional linear models
• On consistency and sparsity for high-dimensional functional time series with application to autoregressions
• Non-asymptotic adaptive prediction in functional linear models
• On the optimal reconstruction of partially observed functional data
• Local linear regression for functional predictor and scalar response
• Honest confidence sets in nonparametric IV regression and other ill-posed models
• M-estimation for functional linear regression
• Optimal estimation for the functional Cox model
• Functional gradient ascent for probit regression
• Linear prediction in functional data analysis
• Polynomial spline estimation for partial functional linear regression models
• Varying coefficient partially functional linear regression models
• Efficient Estimation of the Nonparametric Mean and Covariance Functions for Longitudinal and Sparse Functional Data
• Robust penalized estimators for functional linear regression
• Spline estimators for semi-functional linear model
• Bootstrap in functional linear regression
• M-estimation for partially functional linear regression model based on splines
• Adaptive estimation of linear functionals in functional linear models
• Lower bound in regression for functional data by representation of small ball probabilities
• Functional linear regression with functional response
• Approximating the critical values of Cramér-von Mises tests in general parametric conditional specifications
• Smoothing splines estimators for functional linear regression
• Minimax and adaptive prediction for functional linear regression
• A test of significance in functional quadratic regression
• Partial functional linear regression

Uses Software

• fda (R)

This page was built for publication: Methodology and convergence rates for functional linear regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q997371)