Topic segmentation via community detection in complex networks
From MaRDI portal
Abstract: Many real systems have been modelled in terms of network concepts, and written texts are a particular example of information networks. In recent years, the use of network methods to analyze language has allowed the discovery of several interesting findings, including the proposition of novel models to explain the emergence of fundamental universal patterns. While syntactical networks, one of the most prevalent networked models of written texts, display both scale-free and small-world properties, such representation fails in capturing other textual features, such as the organization in topics or subjects. In this context, we propose a novel network representation whose main purpose is to capture the semantical relationships of words in a simple way. To do so, we link all words co-occurring in the same semantic context, which is defined in a threefold way. We show that the proposed representations favours the emergence of communities of semantically related words, and this feature may be used to identify relevant topics. The proposed methodology to detect topics was applied to segment selected Wikipedia articles. We have found that, in general, our methods outperform traditional bag-of-words representations, which suggests that a high-level textual representation may be useful to study semantical features of texts.
Recommendations
- The stochastic topic block model for the clustering of vertices in networks with textual edges
- Modeling community structure and topics in dynamic text networks
- Topical network embedding
- SPECTRAL METHODS CLUSTER WORDS OF THE SAME CLASS IN A SYNTACTIC DEPENDENCY NETWORK
- Semantic community detection research based on topic probability models
Cites work
- 10.1162/jmlr.2003.3.4-5.993
- An online expectation maximization algorithm for exploring general structure in massive networks
- Authorship recognition via fluctuation analysis of network topology and word intermittency
- COMPLEX NETWORKS ANALYSIS OF MANUAL AND MACHINE TRANSLATIONS
- Fast unfolding of communities in large networks
- scientific article; zbMATH DE number 1408945 (Why is no real title available?)
- The worldwide air transportation network: Anomalous centrality, community structure, and cities' global roles
Cited in
(6)- Topic segmentation and labeling in asynchronous conversations
- Social mechanisms of the subject area formation. The case of ``digital economy
- SPECTRAL METHODS CLUSTER WORDS OF THE SAME CLASS IN A SYNTACTIC DEPENDENCY NETWORK
- COMPLEX NETWORKS ANALYSIS OF MANUAL AND MACHINE TRANSLATIONS
- Complex semantic networks
- Prose and poetry classification and boundary detection using word adjacency network analysis
This page was built for publication: Topic segmentation via community detection in complex networks
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4591840)
