On the incommensurability phenomenon

DOI10.1007/S00357-016-9203-9zbMATH Open1349.62249arXiv1301.1954OpenAlexW1485831816MaRDI QIDQ333335FDOQ333335

Cencheng Shen, Donniell E. Fishkind, Carey E. Priebe, Youngser Park

Publication date: 28 October 2016

Published in: Journal of Classification (Search for Journal in Brave)

Abstract: Suppose that two large, multi-dimensional data sets are each noisy measurements of the same underlying random process, and principle components analysis is performed separately on the data sets to reduce their dimensionality. In some circumstances it may happen that the two lower-dimensional data sets have an inordinately large Procrustean fitting-error between them. The purpose of this manuscript is to quantify this "incommensurability phenomenon." In particular, under specified conditions, the square Procrustean fitting-error of the two normalized lower-dimensional data sets is (asymptotically) a convex combination (via a correlation parameter) of the Hausdorff distance between the projection subspaces and the maximum possible value of the square Procrustean fitting-error for normalized data. We show how this gives rise to the incommensurability phenomenon, and we employ illustrative simulations as well as a real data experiment to explore how the incommensurability phenomenon may have an appreciable impact.

Full work available at URL: https://arxiv.org/abs/1301.1954

zbMATH Keywords

Hausdorff distanceprincipal components analysisGrassmannianincommensurability phenomenonProcrustes fitting

Mathematics Subject Classification ID

Factor analysis and principal components; correspondence analysis (62H25) Classification and discrimination; cluster analysis (statistical aspects) (62H30)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis
• Principal component analysis.
• Statistics on special manifolds
• Modern multidimensional scaling. Theory and applications.
• Robust principal component analysis?
• RELATIONS BETWEEN TWO SETS OF VARIATES
• Some properties of invariant sets of a flow
• Laplacian Eigenmaps for Dimensionality Reduction and Data Representation
• Canonical Correlation Analysis: An Overview with Application to Learning Methods
• Local Procrustes for manifold embedding: a measure of embedding quality and embedding algorithms
• Generalized canonical correlation analysis for classification
• Manifold matching: joint optimization of fidelity and commensurability
• Unitarily Invariant Metrics on the Grassmann Space

Cited In (3)

• Dimension of the singular sets of plane-fitters
• Statistical inference on random dot product graphs: a survey
• On the theory of material inhomogeneities

Uses Software

• PMA

This page was built for publication: On the incommensurability phenomenon

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q333335)