Tsallis mutual information for document classification

DOI10.3390/E13091694MaRDI QIDQ400940zbMATH OpenOpenAlexFDO

Authors Màrius Vila, Anton Bardera, Miquel Feixas, Mateu Sbert

Publication date 26 August 2014

Published in Entropy (Search for Journal in Brave)

Full work available at URL https://doi.org/10.3390/e13091694

zbMATH Keywords

document classificationimage similaritymutual informationscanned documentsTsallis entropy

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Image analysis in multivariate analysis (62H35) Measures of information, entropy (94A17)

Review text

Summary: Mutual information is one of the mostly used measures for evaluating image~similarity. In this paper, we investigate the application of three different Tsallis-based~generalizations of mutual information to analyze the similarity between scanned documents.~These three generalizations derive from the Kullback-Leibler distance, the difference~between entropy and conditional entropy, and the Jensen-Tsallis divergence, respectively.~In addition, the ratio between these measures and the Tsallis joint entropy is analyzed. The~performance of all these measures is studied for different entropic indexes in the context of document classification and registration.

Recommendations

• Information-theoretic method for classification of texts
• Mutual information calculation using empirical classification
• Structural, Syntactic, and Statistical Pattern Recognition
• Multi-class and Cluster Evaluation Measures Based on Rényi and Tsallis Entropies and Mutual Information
• The improvement research of mutual information algorithm for text categorization
• 10.1162/153244303322753661

Cites work

• A hierarchical representation of form documents for identification and retrieval
• scientific article; zbMATH DE number 4127147 (Why is no real title available?)
• Information theoretical properties of Tsallis entropies
• Information theory and network coding
• On the convexity of some divergence measures based on entropy functions
• Possible generalization of Boltzmann-Gibbs statistics.

Cited in

(9)

• Tsallis conditional mutual information in investigating long range correlation in symbol sequences
• Regularization with maximum entropy and quantum electrodynamics: the MERG(E) estimators
• Tsallis entropy for geometry simplification
• Special issue: Tsallis entropy
• Entropy-based block processing for satellite image registration
• scientific article; zbMATH DE number 7149440 (Why is no real title available?)
• Multi-class and Cluster Evaluation Measures Based on Rényi and Tsallis Entropies and Mutual Information
• Jensen-Tsallis divergence for supervised classification under data imbalance
• A bias correction for the mutual information sample estimator

This page was built for publication: Tsallis mutual information for document classification

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q400940)