A reproducing kernel Hilbert space approach to functional linear regression

DOI10.1214/09-AOS772zbMATH Open1204.62074arXiv1211.2607OpenAlexW2059173978MaRDI QIDQ620554FDOQ620554

Authors: Ming Yuan, T. Tony Cai 

Publication date: 19 January 2011

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive definite kernels, we obtain shaper results on the minimax rates of convergence and show that smoothness regularized estimators achieve the optimal rates of convergence for both prediction and estimation under conditions weaker than those for the functional principal components based methods developed in the literature. Despite the generality of the method of regularization, we show that the procedure is easily implementable. Numerical results are obtained to illustrate the merits of the method and to demonstrate the theoretical developments.

Full work available at URL: https://arxiv.org/abs/1211.2607

Recommendations

• Minimax prediction for functional linear regression with functional responses in reproducing kernel Hilbert spaces
• Analysis of regularized least squares for functional linear regression model
• Faster convergence rate for functional linear regression in reproducing kernel Hilbert spaces
• Minimax and adaptive prediction for functional linear regression
• Methodology and convergence rates for functional linear regression

zbMATH Keywords

covarianceprincipal component analysisreproducing kernel Hilbert spaceminimaxoptimal convergence rateeigenfunctioneigenvalueSobolev spacefunctional linear regressionsimultaneous diagonalizationSacks-Ylvisaker conditionsslope function

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20) Factor analysis and principal components; correspondence analysis (62H25) Linear regression; mixed models (62J05) Applications of functional analysis in probability theory and statistics (46N30)

Cites Work

• Functional data analysis.
• Nonparametric functional data analysis. Theory and practice.
• On the estimation of a probability density function by the maximum penalized likelihood method
• Interpolation of spatial data. Some theory for kriging
• Designs for Regression Problems With Correlated Errors: Many Parameters
• Title not available (Why is that?)
• Title not available (Why is that?)
• Functional linear regression analysis for longitudinal data
• Generalized functional linear models
• Estimation in generalized linear models for functional data via penalized likelihood
• On the mathematical foundations of learning
• Generalized Linear Models with Functional Predictors
• Prediction in functional linear regression
• Title not available (Why is that?)
• Asymptotic analysis of penalized likelihood and related estimators
• Title not available (Why is that?)
• On rates of convergence in functional linear regression
• Methodology and convergence rates for functional linear regression
• Designs for Regression Problems with Correlated Errors
• Smoothing splines estimators for functional linear regression
• Designs for Regression Problems with Correlated Errors III
• Multivariate integration and approximation for random fields satisfying Sacks-Ylvisaker conditions

Cited In (only showing first 100 items - show all)

• Bayesian functional linear regression with sparse step functions
• Wasserstein Regression
• Convergence rates of support vector machines regression for functional data
• A Gradient Iteration Method for Functional Linear Regression in Reproducing Kernel Hilbert Spaces
• Predicting clinical outcomes in glioblastoma: an application of topological and functional data analysis
• Estimation of linear operators from scattered impulse responses
• Functional Finite Mixture Regression Models
• Kernel methods in system identification, machine learning and function estimation: a survey
• Regression models for functional data by reproducing kernel Hilbert spaces methods
• An RKHS model for variable selection in functional linear regression
• Estimation and testing for partially functional linear errors-in-variables models
• Reproducing kernel Hilbert spaces and local polynomial estimation of smooth functionals
• Penalized contrast estimation in functional linear models with circular data
• \(L_1\)-penalization in functional linear regression with subgaussian design
• Robust functional regression based on principal components
• Statistical inference for the slope parameter in functional linear regression
• A sieve stochastic gradient descent estimator for online nonparametric regression in Sobolev ellipsoids
• Estimating functional linear mixed-effects regression models
• Functional sliced inverse regression in a reproducing kernel Hilbert space: a theoretical connection to functional linear regression
• Nonparametric random effects functional regression model using Gaussian process priors
• Bayesian robust estimation of partially functional linear regression models using heavy-tailed distributions
• Linearly constrained reconstruction of functions by kernels with applications to machine learning
• Functional linear regression after spline transformation
• Optimal Penalized Function-on-Function Regression Under a Reproducing Kernel Hilbert Space Framework
• Optimal prediction for high-dimensional functional quantile regression in reproducing kernel Hilbert spaces
• Nonparametric inference in generalized functional linear models
• Smooth predictive model fitting in regression
• Partial functional partially linear single-index models
• Methodology and convergence rates for functional linear regression
• Partially functional linear regression in reproducing kernel Hilbert spaces
• Intrinsic Riemannian functional data analysis
• Optimal estimation for the functional Cox model
• System identification using kernel-based regularization: new insights on stability and consistency issues
• A note on generalized functional linear model and its application
• Linear prediction in functional data analysis
• Posterior convergence for Bayesian functional linear regression
• Estimation in functional linear quantile regression
• Functional Regression for Densely Observed Data With Novel Regularization
• Robust penalized estimators for functional linear regression
• Sieve M-estimator for a semi-functional linear model
• Smoothing splines estimators for functional linear regression
• Minimax and adaptive prediction for functional linear regression
• Reduced rank modeling for functional regression with functional responses
• Optimal prediction of quantile functional linear regression in reproducing kernel Hilbert spaces
• Bayesian classification of multiclass functional data
• On rates of convergence in functional linear regression
• Minimax adaptive tests for the functional linear model
• Probability-enhanced effective dimension reduction for classifying sparse functional data
• Single-index partially functional linear regression model
• Inference for generalized partial functional linear regression
• Multivariate functional linear regression and prediction
• Estimation in partially observed functional linear quantile regression
• On prediction rate in partial functional linear regression
• Minimax prediction for functional linear regression with functional responses in reproducing kernel Hilbert spaces
• PCA-based estimation for functional linear regression with functional responses
• Estimating Truncated Functional Linear Models With a Nested Group Bridge Approach
• Sparse estimation in functional linear regression
• Statistical inference for the functional quadratic quantile regression model
• A note on estimation in Hilbertian linear models
• High-Dimensional Spatial Quantile Function-on-Scalar Regression
• Nonlinear functional models for functional responses in reproducing kernel hilbert spaces
• Analysis of regularized least squares for functional linear regression model
• Estimation of functional regression model via functional dimension reduction
• The M-estimator for functional linear regression model
• Structured Functional Additive Regression in Reproducing Kernel Hilbert Spaces
• Dynamic single-index model for functional data
• Principal components analysis for sparsely observed correlated functional data using a kernel smoothing approach
• Robust and adaptive functional logistic regression
• Bayesian frequentist bounds for machine learning and system identification
• Functional linear regression with Huber loss
• Estimation for Functional Single Index Models with Unknown Link Functions
• Prediction in functional regression with discretely observed and noisy covariates
• Statistical inference in the partial functional linear expectile regression model
• Guaranteed Functional Tensor Singular Value Decomposition
• Faster convergence rate for functional linear regression in reproducing kernel Hilbert spaces
• Functional reproducing kernel Hilbert spaces for non-point-evaluation functional data
• On the convergence of gradient descent for robust functional linear regression
• Functional linear quantile regression on a two-dimensional domain
• M-estimation for varying coefficient models with a functional response in a reproducing kernel Hilbert space
• Robust estimation for a general functional single index model via quantile regression
• Robust estimation for partial functional linear regression model based on modal regression
• Modelling functional additive quantile regression using support vector machines approach
• Hybrid regularisation and the (in)admissibility of ridge regression in infinite dimensional Hilbert spaces
• Adaptive global testing for functional linear models
• On the validity of the bootstrap hypothesis testing in functional linear regression
• Online gradient descent algorithms for functional data learning
• Spectral algorithms for functional linear regression
• Coefficient regularizer based simultaneous regression estimation
• An RKHS approach for pivotal inference in functional linear regression
• Non-asymptotic error bound for optimal prediction of function-on-function regression by RKHS approach
• Testing linearity in partial functional linear quantile regression model based on regression rank scores
• Direct Bayesian linear regression for distribution-valued covariates
• Capacity dependent analysis for functional online learning algorithms
• Bayesian scalar on image regression with nonignorable nonresponse
• In-game win probabilities for the National Rugby League
• Stochastic functional linear models and Malliavin calculus
• Functional principal subspace sampling for large scale functional data analysis
• Semiparametric Inference for the Functional Cox Model
• Composite quantile estimation in partial functional linear regression model with dependent errors
• Asynchronous Functional Linear Regression Models for Longitudinal Data in Reproducing Kernel Hilbert Space

Uses Software

• fda (R)

This page was built for publication: A reproducing kernel Hilbert space approach to functional linear regression

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q620554)