MIC: Mutual Information Based Hierarchical Clustering

DOI10.1007/978-0-387-84816-7_5MaRDI QIDQ3613560zbMATH OpenOpenAlexFDO

Authors Alexander Kraskov, P. Grassberger

Publication date 12 March 2009

Published in Information Theory and Statistical Learning (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/0809.1605

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Measures of information, entropy (94A17)

Abstract: Clustering is a concept used in a huge variety of applications. We review a conceptually very simple algorithm for hierarchical clustering called in the following the {it mutual information clustering} (MIC) algorithm. It uses mutual information (MI) as a similarity measure and exploits its grouping property: The MI between three objects X, Y, and Z is equal to the sum of the MI between X and Y, plus the MI between Z and the combined object (XY). We use MIC both in the Shannon (probabilistic) version of information theory, where the "objects" are probability distributions represented by random samples, and in the Kolmogorov (algorithmic) version, where the "objects" are symbol sequences. We apply our method to the construction of phylogenetic trees from mitochondrial DNA sequences and we reconstruct the fetal ECG from the output of independent components analysis (ICA) applied to the ECG of a pregnant woman.

Recommendations

• Agglomerative hierarchical clustering of continuous variables based on mutual information
• scientific article; zbMATH DE number 1849132
• MIB: using mutual information for biclustering gene expression data
• A bioinformatic implementation of mutual information as a distance measure for identification of clusters of variables
• Information-based clustering

Cited in

(10)

• Flow of information during an evolutionary process: the case of influenza A viruses
• Pattern classification of phylogeny signals
• Redefinition of mutual information in the fuzzy sets framework for computational genomics
• scientific article; zbMATH DE number 1849132 (Why is no real title available?)
• Causality of energy-containing eddies in wall turbulence
• Information-maximization clustering based on squared-loss mutual information
• Modeling and Using Context
• Causality analysis of large-scale structures in the flow around a wall-mounted square cylinder
• Agglomerative hierarchical clustering of continuous variables based on mutual information
• MIB: using mutual information for biclustering gene expression data

This page was built for publication: MIC: Mutual Information Based Hierarchical Clustering

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3613560)