Optimal Penalized Function-on-Function Regression Under a Reproducing Kernel Hilbert Space Framework
From MaRDI portal
Abstract: Many scientific studies collect data where the response and predictor variables are both functions of time, location, or some other covariate. Understanding the relationship between these functional variables is a common goal in these studies. Motivated from two real-life examples, we present in this paper a function-on-function regression model that can be used to analyze such kind of functional data. Our estimator of the 2D coefficient function is the optimizer of a form of penalized least squares where the penalty enforces a certain level of smoothness on the estimator. Our first result is the Representer Theorem which states that the exact optimizer of the penalized least squares actually resides in a data-adaptive finite dimensional subspace although the optimization problem is defined on a function space of infinite dimensions. This theorem then allows us an easy incorporation of the Gaussian quadrature into the optimization of the penalized least squares, which can be carried out through standard numerical procedures. We also show that our estimator achieves the minimax convergence rate in mean prediction under the framework of function-on-function regression. Extensive simulation studies demonstrate the numerical advantages of our method over the existing ones, where a sparse functional data extension is also introduced. The proposed method is then applied to our motivating examples of the benchmark Canadian weather data and a histone regulation study.
Recommendations
- Reproducing Kernel Hilbert Spaces for Penalized Regression: A Tutorial
- A reproducing kernel Hilbert space approach to functional linear regression
- Regression models for functional data by reproducing kernel Hilbert spaces methods
- Optimal prediction for high-dimensional functional quantile regression in reproducing kernel Hilbert spaces
- Partially functional linear regression in reproducing kernel Hilbert spaces
- Optimal prediction of quantile functional linear regression in reproducing kernel Hilbert spaces
- Minimax prediction for functional linear regression with functional responses in reproducing kernel Hilbert spaces
- A Gradient Iteration Method for Functional Linear Regression in Reproducing Kernel Hilbert Spaces
- Penalized solutions to functional regression problems
- Structured Functional Additive Regression in Reproducing Kernel Hilbert Spaces
Cites work
- scientific article; zbMATH DE number 45848 (Why is no real title available?)
- A reproducing kernel Hilbert space approach to functional linear regression
- Asymptotics of prediction in functional linear regression with functional outputs
- Bayesian function-on-function regression for multilevel functional data
- Effective dimension reduction for sparse functional data
- Functional Data Analysis for Sparse Longitudinal Data
- Functional Data Analysis with R and MATLAB
- Functional data analysis.
- Functional linear regression analysis for longitudinal data
- Functional linear regression with functional response
- Functional sliced inverse regression analysis
- Identifiability in penalized function-on-function regression models
- Kernel regression with functional response
- Linear functional regression: The case of fixed design and functional response
- Methodology and theory for partial least squares applied to functional data
- Minimax and adaptive prediction for functional linear regression
- Minimax prediction for functional linear regression with functional responses in reproducing kernel Hilbert spaces
- Optimal estimation of the mean function based on discretely sampled functional data: phase transition
- PLS regression on a stochastic process
- Penalized function-on-function regression
- Penalized likelihood functional regression
- Smoothing Spline Gaussian Regression: More Scalable Computation via Efficient Approximation
- Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
- The historical functional linear model
Cited in
(32)- Functional linear quantile regression on a two-dimensional domain
- Functional sufficient dimension reduction through average Fréchet derivatives
- Envelope Model for Function-on-Function Linear Regression
- From multivariate to functional data analysis: fundamentals, recent developments, and emerging areas
- Penalized function-on-function regression
- Function-on-function quadratic regression models
- Nonparametric random effects functional regression model using Gaussian process priors
- Non-asymptotic error bound for optimal prediction of function-on-function regression by RKHS approach
- Partially functional linear regression in reproducing kernel Hilbert spaces
- Two-sample inference for sparse functional data
- Stochastic functional linear models and Malliavin calculus
- An adaptive model checking test for the functional linear model
- Advances in estimation and inference for historical functional linear models
- Statistical inference for function-on-function linear regression
- Functional Regression for Densely Observed Data With Novel Regularization
- A Reproducing Kernel Hilbert Space Framework for Functional Classification
- Optimal Function-on-Function Regression With Interaction Between Functional Predictors
- Fast implementation of partial least squares for function-on-function regression
- Restricted function‐on‐function linear regression model
- Modern nonlinear function-on-function regression
- Two-sample functional linear models with functional responses
- Value iteration for streaming data on a continuous space with gradient method in an RKHS
- Optimal function-on-scalar regression over complex domains
- Estimation and Model Selection for Nonparametric Function-on-Function Regression
- High-Dimensional Spatial Quantile Function-on-Scalar Regression
- Reproducing Kernel Hilbert Spaces for Penalized Regression: A Tutorial
- Estimation and inference for functional linear regression models with partially varying regression coefficients
- Robust penalized M-estimation for function-on-function linear regression
- Optimal prediction for additive function-on-function regression
- Variable Selection for Multiple Function-on-Function Linear Regression
- Low-Rank Covariance Function Estimation for Multidimensional Functional Data
- Sparse and smooth functional data clustering
This page was built for publication: Optimal Penalized Function-on-Function Regression Under a Reproducing Kernel Hilbert Space Framework
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3121182)
