Fast covariance estimation for high-dimensional functional data
From MaRDI portal
Publication:2631375
Abstract: For smoothing covariance functions, we propose two fast algorithms that scale linearly with the number of observations per function. Most available methods and software cannot smooth covariance matrices of dimension with ; the recently introduced sandwich smoother is an exception, but it is not adapted to smooth covariance matrices of large dimensions such as . Covariance matrices of order , and even , are becoming increasingly common, e.g., in 2- and 3-dimensional medical imaging and high-density wearable sensor data. We introduce two new algorithms that can handle very large covariance matrices: 1) FACE: a fast implementation of the sandwich smoother and 2) SVDS: a two-step procedure that first applies singular value decomposition to the data matrix and then smoothes the eigenvectors. Compared to existing techniques, these new algorithms are at least an order of magnitude faster in high dimensions and drastically reduce memory requirements. The new algorithms provide instantaneous (few seconds) smoothing for matrices of dimension and very fast ( 10 minutes) smoothing for . Although SVDS is simpler than FACE, we provide ready to use, scalable R software for FACE. When incorporated into R package {it refund}, FACE improves the speed of penalized functional regression by an order of magnitude, even for data of normal size (). We recommend that FACE be used in practice for the analysis of noisy and high-dimensional functional data.
Recommendations
Cites work
- scientific article; zbMATH DE number 469124 (Why is no real title available?)
- scientific article; zbMATH DE number 469335 (Why is no real title available?)
- scientific article; zbMATH DE number 3046994 (Why is no real title available?)
- An Accelerated-Time Model for Response Curves
- Applied functional data analysis. Methods and case studies
- Asymptotic theory for the principal component analysis of a vector random function: Some applications to statistical inference
- Confidence Intervals for Nonparametric Curve Estimates
- Fast bivariate \(P\)-splines: the sandwich smoother
- Flexible smoothing with B-splines and penalties. With comments and a rejoinder by the authors
- Functional Data Analysis for Sparse Longitudinal Data
- Functional data analysis.
- Generalized multilevel functional regression
- Longitudinal functional principal component analysis
- Longitudinal high-dimensional principal components analysis with application to diffusion tensor imaging of multiple sclerosis
- Multilevel functional principal component analysis
- Nonparametric Regression Analysis of Longitudinal Data
- Nonparametric estimation of common regressors for similar curve data
- Nonparametric estimation of smoothed principal components analysis of sampled noisy functions
- On the asymptotics of penalized spline smoothing
- On the sample covariance matrix estimator of reduced effective rank population matrices, with applications to fPCA
- Principal components analysis of sampled functions
- Semiparametric Regression
- Shrinkage estimation for functional principal component scores with application to the population kinetics of plasma folate
- Simultaneous non-parametric regressions of unbalanced longitudinal data
- Smoothing Spline Gaussian Regression: More Scalable Computation via Efficient Approximation
- Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
- Statistical inferences for functional data
- Structured functional principal component analysis
- Thin Plate Regression Splines
Cited in
(26)- Functional analysis of spatial aggregation regions of Jeffrey pine Beetle-attack within the Lake Tahoe Basin
- Fast bivariate \(P\)-splines: the sandwich smoother
- Homogeneity tests of covariance for high-dimensional functional data with applications to event segmentation
- CovNet: Covariance Networks for Functional Data on Multidimensional Domains
- On variable ordination of Cholesky‐based estimation for a sparse covariance matrix
- Longitudinal high-dimensional principal components analysis with application to diffusion tensor imaging of multiple sclerosis
- Fast Multilevel Functional Principal Component Analysis
- Commentary: Methods for calculating growth trajectories and constructing growth centiles
- Bayesian inference and dynamic prediction of multivariate joint model with functional data: an application to Alzheimer's disease
- Fast symmetric additive covariance smoothing
- Sensible functional linear discriminant analysis
- Optimal EMG placement for a robotic prosthesis controller with sequential, adaptive functional estimation (SAFE)
- Dynamic child growth prediction: A comparative methods approach
- Comparing predictive abilities of longitudinal child growth models
- Scalable multiple changepoint detection for functional data sequences
- Gaussian graphical modeling for spectrometric data analysis
- Conditional analysis for mixed covariates, with application to feed intake of lactating sows
- Fast covariance estimation for sparse functional data
- Estimation of the nonparametric mean and covariance functions for multivariate longitudinal and sparse functional data
- Fixed-effects inference and tests of correlation for longitudinal functional data
- Linear scalar-on-surface random effects regression models
- Estimation for Extreme Conditional Quantiles of Functional Quantile Regression
- Additive Functional Cox Model
- Randomized estimation of functional covariance operator via subsampling
- Two-Dimensional Functional Principal Component Analysis for Image Feature Extraction
- Low-Rank Covariance Function Estimation for Multidimensional Functional Data
This page was built for publication: Fast covariance estimation for high-dimensional functional data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2631375)
