Robust regularized singular value decomposition with application to mortality data
From MaRDI portal
Computational methods for problems pertaining to statistics (62-08) Factor analysis and principal components; correspondence analysis (62H25) Applications of statistics to biology and medical sciences; meta analysis (62P10) Robustness and adaptive procedures (parametric inference) (62F35) Functional data analysis (62R10)
Abstract: We develop a robust regularized singular value decomposition (RobRSVD) method for analyzing two-way functional data. The research is motivated by the application of modeling human mortality as a smooth two-way function of age group and year. The RobRSVD is formulated as a penalized loss minimization problem where a robust loss function is used to measure the reconstruction error of a low-rank matrix approximation of the data, and an appropriately defined two-way roughness penalty function is used to ensure smoothness along each of the two functional domains. By viewing the minimization problem as two conditional regularized robust regressions, we develop a fast iterative reweighted least squares algorithm to implement the method. Our implementation naturally incorporates missing values. Furthermore, our formulation allows rigorous derivation of leave-one-row/column-out cross-validation and generalized cross-validation criteria, which enable computationally efficient data-driven penalty parameter selection. The advantages of the new robust method over nonrobust ones are shown via extensive simulation studies and the mortality rate application.
Recommendations
- The analysis of two-way functional data using two-way regularized singular value decompositions
- Sparse-smooth regularized singular value decomposition
- Statistical inference based on robust low-rank data matrix approximation
- Robust singular value decomposition analysis of microarray data
- Functional Singular Component Analysis
Cites work
- scientific article; zbMATH DE number 5377166 (Why is no real title available?)
- scientific article; zbMATH DE number 45848 (Why is no real title available?)
- scientific article; zbMATH DE number 700016 (Why is no real title available?)
- scientific article; zbMATH DE number 961607 (Why is no real title available?)
- A spatio-temporal solution for the EEG/MEG inverse problem using group penalization methods
- Applied functional data analysis. Methods and case studies
- Detecting and handling outlying trajectories in irregularly sampled functional datasets
- Forecasting functional time series
- Functional Data Analysis for Sparse Longitudinal Data
- Functional data analysis.
- Functional principal components analysis via penalized rank one approximation
- Least Median of Squares Regression
- Lower Rank Approximation of Matrices by Least Squares with Any Choice of Weights
- Nonparametric functional data analysis. Theory and practice.
- Robust Singular Value Decompositions: A New Approach to Projection Pursuit
- Robust Statistics
- Robust Statistics
- Robust estimation of the self-similarity parameter in network traffic using wavelet transform
- Robust factor analysis.
- Robust forecasting of mortality and fertility rates: a functional data approach
- Robust functional estimation using the median and spherical principal components
- Robust functional principal components: a projection-pursuit approach
- Robust principal component analysis for functional data. (With comments)
- Robust regularized singular value decomposition with application to mortality data
- Robust singular value decomposition analysis of microarray data
- Smoothed functional principal components analysis by choice of norm
- Some results on Tchebycheffian spline functions and stochastic processes
- Sparse logistic principal components analysis for binary data
- The analysis of two-way functional data using two-way regularized singular value decompositions
- The functional singular value decomposition for bivariate stochastic processes
- Use of multiple singular value decompositions to analyze complex intracellular calcium ion signals
Cited in
(14)- Intergenerational actuarial fairness when longevity increases: amending the retirement age
- Intraday forecasts of a volatility index: functional time series methods with dynamic updating
- Robust low-rank data matrix approximations
- Testing for a unit root in Lee-Carter mortality model
- Multilevel Matrix-Variate Analysis and its Application to Accelerometry-Measured Physical Activity in Clinical Populations
- Robust deep neural network estimation for multi-dimensional functional data
- The analysis of two-way functional data using two-way regularized singular value decompositions
- Addressing the life expectancy gap in pension policy
- Cauchy robust principal component analysis with applications to high-deimensional data sets
- Robust regularized singular value decomposition with application to mortality data
- Inference pitfalls in Lee-Carter model for forecasting mortality
- A comparative study of singular spectrum analysis, neural network, ARIMA and exponential smoothing for monthly rainfall forecasting
- Robust singular value decomposition with application to video surveillance background modelling
- Low-Rank Covariance Function Estimation for Multidimensional Functional Data
This page was built for publication: Robust regularized singular value decomposition with application to mortality data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q386741)
