A reproducing kernel Hilbert space approach to functional linear regression

DOI10.1214/09-AOS772zbMATH Open1204.62074arXiv1211.2607OpenAlexW2059173978MaRDI QIDQ620554FDOQ620554

T. Tony Cai, Ming Yuan

Publication date: 19 January 2011

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive definite kernels, we obtain shaper results on the minimax rates of convergence and show that smoothness regularized estimators achieve the optimal rates of convergence for both prediction and estimation under conditions weaker than those for the functional principal components based methods developed in the literature. Despite the generality of the method of regularization, we show that the procedure is easily implementable. Numerical results are obtained to illustrate the merits of the method and to demonstrate the theoretical developments.

Full work available at URL: https://arxiv.org/abs/1211.2607

zbMATH Keywords

covarianceprincipal component analysisreproducing kernel Hilbert spaceminimaxoptimal convergence rateeigenfunctioneigenvalueSobolev spacefunctional linear regressionsimultaneous diagonalizationSacks-Ylvisaker conditionsslope function

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Factor analysis and principal components; correspondence analysis (62H25) Linear regression; mixed models (62J05) Applications of functional analysis in probability theory and statistics (46N30)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Functional data analysis.
• Nonparametric functional data analysis. Theory and practice.
• On the estimation of a probability density function by the maximum penalized likelihood method
• Interpolation of spatial data. Some theory for kriging
• Designs for Regression Problems With Correlated Errors: Many Parameters
• Functional linear regression analysis for longitudinal data
• Generalized functional linear models
• Estimation in generalized linear models for functional data via penalized likelihood
• On the mathematical foundations of learning
• Generalized Linear Models with Functional Predictors
• Prediction in functional linear regression
• Asymptotic analysis of penalized likelihood and related estimators
• On rates of convergence in functional linear regression
• Methodology and convergence rates for functional linear regression
• Designs for Regression Problems with Correlated Errors
• Smoothing splines estimators for functional linear regression
• Designs for Regression Problems with Correlated Errors III
• Multivariate integration and approximation for random fields satisfying Sacks-Ylvisaker conditions

Cited In (only showing first 100 items - show all)

• Bayesian functional linear regression with sparse step functions
• Wasserstein Regression
• Convergence rates of support vector machines regression for functional data
• Functional Finite Mixture Regression Models
• Faster convergence rate for functional linear regression in reproducing kernel Hilbert spaces
• Kernel methods in system identification, machine learning and function estimation: a survey
• Functional reproducing kernel Hilbert spaces for non-point-evaluation functional data
• Minimax and Adaptive Prediction for Functional Linear Regression
• An RKHS model for variable selection in functional linear regression
• Estimation and testing for partially functional linear errors-in-variables models
• Penalized contrast estimation in functional linear models with circular data
• \(L_1\)-penalization in functional linear regression with subgaussian design
• Robust functional regression based on principal components
• Statistical inference for the slope parameter in functional linear regression
• A sieve stochastic gradient descent estimator for online nonparametric regression in Sobolev ellipsoids
• Estimating functional linear mixed-effects regression models
• Bayesian robust estimation of partially functional linear regression models using heavy-tailed distributions
• Linearly constrained reconstruction of functions by kernels with applications to machine learning
• Functional linear regression after spline transformation
• Optimal Penalized Function-on-Function Regression Under a Reproducing Kernel Hilbert Space Framework
• Nonparametric inference in generalized functional linear models
• Functional Linear Regression Analysis Based on Partial Least Squares and Its Application
• Title not available (Why is that?)
• Partially functional linear regression in reproducing kernel Hilbert spaces
• Intrinsic Riemannian functional data analysis
• Inference for Generalized partial functional linear regression
• Optimal estimation for the functional Cox model
• System identification using kernel-based regularization: new insights on stability and consistency issues
• A note on generalized functional linear model and its application
• Linear prediction in functional data analysis
• Posterior convergence for Bayesian functional linear regression
• Estimation in functional linear quantile regression
• Functional Regression for Densely Observed Data With Novel Regularization
• Robust penalized estimators for functional linear regression
• A Note on Estimation in Hilbertian Linear Models
• Sieve M-estimator for a semi-functional linear model
• Reduced rank modeling for functional regression with functional responses
• Optimal prediction of quantile functional linear regression in reproducing kernel Hilbert spaces
• Bayesian classification of multiclass functional data
• Adaptive function-on-scalar regression with a smoothing elastic net
• Predicting Clinical Outcomes in Glioblastoma: An Application of Topological and Functional Data Analysis
• Minimax adaptive tests for the functional linear model
• Probability-enhanced effective dimension reduction for classifying sparse functional data
• Single-index partially functional linear regression model
• Estimation and inference in partially functional linear regression with multiple functional covariates
• Multivariate functional linear regression and prediction
• Estimation in partially observed functional linear quantile regression
• On prediction rate in partial functional linear regression
• Minimax prediction for functional linear regression with functional responses in reproducing kernel Hilbert spaces
• PCA-based estimation for functional linear regression with functional responses
• A note on variable selection in functional regression via random subspace method
• Estimating Truncated Functional Linear Models With a Nested Group Bridge Approach
• Sparse estimation in functional linear regression
• The theory and application of penalized methods or reproducing kernel Hilbert spaces made easy
• Adaptive Global Testing for Functional Linear Models
• Statistical inference for the functional quadratic quantile regression model
• High-Dimensional Spatial Quantile Function-on-Scalar Regression
• Title not available (Why is that?)
• Profile Estimation for Partial Functional Partially Linear Single-Index Model
• Analysis of regularized least squares for functional linear regression model
• Estimation of functional regression model via functional dimension reduction
• The M-estimator for functional linear regression model
• Structured Functional Additive Regression in Reproducing Kernel Hilbert Spaces
• Dynamic single-index model for functional data
• Principal components analysis for sparsely observed correlated functional data using a kernel smoothing approach
• Robust and adaptive functional logistic regression
• Bayesian frequentist bounds for machine learning and system identification
• Functional linear regression with Huber loss
• Estimation for Functional Single Index Models with Unknown Link Functions
• Prediction in functional regression with discretely observed and noisy covariates
• Statistical inference in the partial functional linear expectile regression model
• Guaranteed Functional Tensor Singular Value Decomposition
• On the convergence of gradient descent for robust functional linear regression
• Functional linear quantile regression on a two-dimensional domain
• M-estimation for varying coefficient models with a functional response in a reproducing kernel Hilbert space
• Robust estimation for a general functional single index model via quantile regression
• Robust estimation for partial functional linear regression model based on modal regression
• Modelling functional additive quantile regression using support vector machines approach
• Hybrid regularisation and the (in)admissibility of ridge regression in infinite dimensional Hilbert spaces
• On the validity of the bootstrap hypothesis testing in functional linear regression
• Online gradient descent algorithms for functional data learning
• Spectral algorithms for functional linear regression
• An RKHS approach for pivotal inference in functional linear regression
• Non-asymptotic error bound for optimal prediction of function-on-function regression by RKHS approach
• Testing linearity in partial functional linear quantile regression model based on regression rank scores
• Physics Information Aided Kriging using Stochastic Simulation Models
• Direct Bayesian linear regression for distribution-valued covariates
• Capacity dependent analysis for functional online learning algorithms
• In-game win probabilities for the National Rugby League
• Stochastic functional linear models and Malliavin calculus
• Functional principal subspace sampling for large scale functional data analysis
• Semiparametric Inference for the Functional Cox Model
• Composite quantile estimation in partial functional linear regression model with dependent errors
• Asynchronous Functional Linear Regression Models for Longitudinal Data in Reproducing Kernel Hilbert Space
• Statistical inference for function-on-function linear regression
• Checking the adequacy of functional linear quantile regression model
• Latent group detection in functional partially linear regression models
• A Reproducing Kernel Hilbert Space Framework for Functional Classification
• Optimal Function-on-Function Regression With Interaction Between Functional Predictors
• Generalized functional linear model with a point process predictor

Uses Software

• fda (R)

This page was built for publication: A reproducing kernel Hilbert space approach to functional linear regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q620554)