Visualizing probabilistic models and data with intensive principal component analysis

DOI10.1073/PNAS.1817218116MaRDI QIDQ5218558zbMATH OpenOpenAlexWikidataFDO

Authors Katherine N. Quinn, Colin B. Clement, Francesco de Bernardis, Michael D. Niemack, James P. Sethna

Publication date 4 March 2020

Published in Proceedings of the National Academy of Sciences (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1810.02877, https://europepmc.org/articles/pmc6628833

Mathematics Subject Classification ID

Estimation in multivariate analysis (62H12) Factor analysis and principal components; correspondence analysis (62H25) Learning and adaptive systems in artificial intelligence (68T05) Information theory (general) (94A15)

Abstract: Unsupervised learning makes manifest the underlying structure of data without curated training and specific problem definitions. However, the inference of relationships between data points is frustrated by the `curse of dimensionality' in high-dimensions. Inspired by replica theory from statistical mechanics, we consider replicas of the system to tune the dimensionality and take the limit as the number of replicas goes to zero. The result is the intensive embedding, which is not only isometric (preserving local distances) but allows global structure to be more transparently visualized. We develop the Intensive Principal Component Analysis (InPCA) and demonstrate clear improvements in visualizations of the Ising model of magnetic spins, a neural network, and the dark energy cold dark matter ({Lambda}CDM) model as applied to the Cosmic Microwave Background.

Recommendations

• Advanced Lectures on Machine Learning
• Visualizing data using t-SNE
• Probabilistic non-linear principal component analysis with Gaussian process latent variable models
• Supervised principal component analysis: visualization, classification and regression on subspaces and submanifolds
• Probabilistic Principal Component Analysis

Cited in

(1)

• Visualizing statistical models: Removing the blindfold

This page was built for publication: Visualizing probabilistic models and data with intensive principal component analysis

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5218558)