Cauchy robust principal component analysis with applications to high-deimensional data sets

DOI10.48550/ARXIV.2211.03181zbMATH Open1529.62018arXiv2211.03181MaRDI QIDQ89970FDOQ89970

Michail Tsagris, Ayisha Fayomi, Michail Tsagris, Andrew T. A. Wood, Andrew T. A. Wood, Aisha Fouad Fayomi, Yannis Pantazis, Yannis Pantazis

Publication date: 6 November 2022

Published in: Statistics and Computing (Search for Journal in Brave)

Abstract: Principal component analysis (PCA) is a standard dimensionality reduction technique used in various research and applied fields. From an algorithmic point of view, classical PCA can be formulated in terms of operations on a multivariate Gaussian likelihood. As a consequence of the implied Gaussian formulation, the principal components are not robust to outliers. In this paper, we propose a modified formulation, based on the use of a multivariate Cauchy likelihood instead of the Gaussian likelihood, which has the effect of robustifying the principal components. We present an algorithm to compute these robustified principal components. We additionally derive the relevant influence function of the first component and examine its theoretical properties. Simulation experiments on high-dimensional datasets demonstrate that the estimated principal components based on the Cauchy likelihood outperform or are on par with existing robust PCA techniques.

Full work available at URL: https://arxiv.org/abs/2211.03181

zbMATH Keywords

robusthigh-dimensional dataprincipal component analysisCauchy log-likelihood

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Factor analysis and principal components; correspondence analysis (62H25)

Cites Work

• Title not available (Why is that?)
• Robust Estimation of a Location Parameter
• Robust m-estimators of multivariate location and scatter
• Robust principal component analysis?
• Outlier detection for high-dimensional data
• Projection-Pursuit Approach to Robust Dispersion Matrices and Principal Components: Primary Theory and Monte Carlo
• Robust regularized singular value decomposition with application to mortality data
• Robust Procedures in Multivariate Analysis I: Robust Covariance Estimation
• On the unimodality of the likelihood for the Cauchy distribution

This page was built for publication: Cauchy robust principal component analysis with applications to high-deimensional data sets

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q89970)