Distributional similarity for Chinese: exploiting characters and radicals
Summary: Distributional Similarity has attracted considerable attention in the field of natural language processing as an automatic means of countering the ubiquitous problem of sparse data. As a logographic language, Chinese words consist of characters and each of them is composed of one or more radicals. The meanings of characters are usually highly related to the words which contain them. Likewise, radicals often make a predictable contribution to the meaning of a character: characters that have the same components tend to have similar or related meanings. In this paper, we utilize these properties of the Chinese language to improve Chinese word similarity computation. Given a content word, we first extract similar words based on a large corpus and a similarity score for ranking. This rank is then adjusted according to the characters and components shared between the similar word and the target word. Experiments on two gold standard datasets show that the adjusted rank is superior and closer to human judgments than the original rank. In addition to quantitative evaluation, we examine the reasons behind errors drawing on linguistic phenomena for our explanations.
- Co-occurrence retrieval: a flexible framework for lexical distributional similarity
- Computing Chinese semantic orientation via distributional similarity
- A new similarity computing method based on concept similarity in chinese text processing
- scientific article; zbMATH DE number 966906
- Similarity-based models of word cooccurrence probabilities
- A cognitive network for oracle bone characters related to animals
- Co-occurrence retrieval: a flexible framework for lexical distributional similarity
- Chinese word representation learning based on Gaussian distribution and Chinese character component characteristics
- Computing Chinese semantic orientation via distributional similarity
- scientific article; zbMATH DE number 1897874 (Why is no real title available?)
- scientific article; zbMATH DE number 966906 (Why is no real title available?)
- A new similarity computing method based on concept similarity in chinese text processing
This page was built for publication: Distributional similarity for Chinese: exploiting characters and radicals
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1954686)
