Simultaneous estimation of nongaussian components and their correlation structure
From MaRDI portal
Abstract: The statistical dependencies which independent component analysis (ICA) cannot remove often provide rich information beyond the linear independent components. It would thus be very useful to estimate the dependency structure from data. While such models have been proposed, they usually concentrated on higher-order correlations such as energy (square) correlations. Yet, linear correlations are a most fundamental and informative form of dependency in many real data sets. Linear correlations are usually completely removed by ICA and related methods, so they can only be analyzed by developing new methods which explicitly allow for linearly correlated components. In this paper, we propose a probabilistic model of linear non-Gaussian components which are allowed to have both linear and energy correlations. The precision matrix of the linear components is assumed to be randomly generated by a higher-order process and explicitly parametrized by a parameter matrix. The estimation of the parameter matrix is shown to be particularly simple because using score matching, the objective function is a quadratic form. Using simulations with artificial data, we demonstrate that the proposed method improves identifiability of non-Gaussian components by simultaneously learning their correlation structure. Applications on simulated complex cells with natural image input, as well as spectrograms of natural audio data show that the method finds new kinds of dependencies between the components.
Recommendations
Cites work
- 10.1162/jmlr.2003.4.7-8.1205
- A Hierarchical Bayesian Model for Learning Nonlinear Statistical Regularities in Nonstationary Natural Signals
- A linear non-Gaussian acyclic model for causal discovery
- A Two-Layer Model of Natural Stimuli Estimated with Score Matching
- Correlated topographic analysis: estimating an ordering of correlated components
- Emergence of invariant-feature detectors in the adaptive-subspace self-organizing map
- Estimation of non-normalized statistical models by score matching
- scientific article; zbMATH DE number 1179517 (Why is no real title available?)
- scientific article; zbMATH DE number 6253954 (Why is no real title available?)
- scientific article; zbMATH DE number 6276120 (Why is no real title available?)
- scientific article; zbMATH DE number 3024913 (Why is no real title available?)
- Independent component analysis, a new concept?
- Matrix Analysis
- Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data
- Natural image statistics. A probabilistic approach to early computational vision.
- Self-organizing maps
- Some extensions of score matching
- Sparse inverse covariance estimation with the graphical lasso
- Sparse spectrotemporal coding of sounds
- Topographic independent component analysis
- Topographic Product Models Applied to Natural Scene Statistics
- Training Products of Experts by Minimizing Contrastive Divergence
This page was built for publication: Simultaneous estimation of nongaussian components and their correlation structure
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5380858)
