Entropy analysis of word-length series of natural language texts: effects of text language and genre

DOI10.1142/S0218127412502239MaRDI QIDQ4907094zbMATH OpenFDO

Authors Maria Kalimeri, V. Constantoudis, Constantinos Papadimitriou, K. Karamanos, F. K. Diakonos, Haris Papageorgiou

Publication date 1 March 2013

Published in International Journal of Bifurcation and Chaos in Applied Sciences and Engineering (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1401.4205

zbMATH Keywords

\(n\)-gram entropiesquantitative linguisticssymbolic dynamicstime seriesword-length representation

Mathematics Subject Classification ID

Symbolic dynamics (37B10) Time series analysis of dynamical systems (37M10) Natural language processing (68T50)

Abstract: We estimate the $n$-gram entropies of natural language texts in word-length representation and find that these are sensitive to text language and genre. We attribute this sensitivity to changes in the probability distribution of the lengths of single words and emphasize the crucial role of the uniformity of probabilities of having words with length between five and ten. Furthermore, comparison with the entropies of shuffled data reveals the impact of word length correlations on the estimated $n$-gram entropies.

Recommendations

• Entropy of natural languages: Theory and experiment
• Entropy estimation of symbol sequences
• ENTROPIC ANALYSIS OF THE ROLE OF WORDS IN LITERARY TEXTS
• On the Entropy of Written Spanish
• Word frequency and entropy of symbolic sequences: A dynamical perspective

Cites work

• A Mathematical Theory of Communication
• Entropy analysis of substitutive sequences revisited
• scientific article; zbMATH DE number 3143967 (Why is no real title available?)
• Prediction and Entropy of Printed English
• Super-selection rules modulating complexity: an overview
• Symbolic dynamics and entropy analysis of Feigenbaum limit sets
• Toward a probabilistic approach to complex systems
• Word frequency and entropy of symbolic sequences: A dynamical perspective

Cited in

(10)

• Word frequency and entropy of symbolic sequences: A dynamical perspective
• Entropy of natural languages: Theory and experiment
• Approaching word length distribution via level spectra
• Towards the quantification of the semantic information encoded in written language
• ENTROPIC ANALYSIS OF THE ROLE OF WORDS IN LITERARY TEXTS
• scientific article; zbMATH DE number 2010005 (Why is no real title available?)
• Two halves of a meaningful text are statistically different
• Excess entropy in natural language: present state and perspectives
• On the Entropy of Written Spanish
• A comparative dynamical analysis of Hebrew texts

This page was built for publication: Entropy analysis of word-length series of natural language texts: effects of text language and genre

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4907094)