Improved feature weight algorithm and its application to text classification

DOI10.1155/2016/7819626MaRDI QIDQ1793568zbMATH OpenOpenAlexWikidataFDO

Authors Songtao Shang, Minyong Shi, Wenqian Shang, Zhiguo Hong

Publication date 12 October 2018

Published in Mathematical Problems in Engineering (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://doi.org/10.1155/2016/7819626

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)

Review text

Summary: Text preprocessing is one of the key problems in pattern recognition and plays an important role in the process of text classification. Text preprocessing has two pivotal steps: feature selection and feature weighting. The preprocessing results can directly affect the classifiers' accuracy and performance. Therefore, choosing the appropriate algorithm for feature selection and feature weighting to preprocess the document can greatly improve the performance of classifiers. According to the Gini Index theory, this paper proposes an Improved Gini Index algorithm. This algorithm constructs a new feature selection and feature weighting function. The experimental results show that this algorithm can improve the classifiers' performance effectively. At the same time, this algorithm is applied to a sensitive information identification system and has achieved a good result. The algorithm's precision and recall are higher than those of traditional ones. It can identify sensitive information on the Internet effectively.

Recommendations

• Structural, Syntactic, and Statistical Pattern Recognition
• Fuzzy \(k\)NN text classifier based on Gini index
• Research of an improved information gain method using distribution information of terms
• scientific article; zbMATH DE number 1884371
• Bayesian classifier-based maximum discriminant feature selection algorithm for text classification

Cites work

• Advances in machine learning based text categorization

Cited in

(3)

• Minimization of \(p\)-Laplacian via the finite element method in MATLAB
• Intelligent recognition algorithm for social network sensitive information based on classification technology
• Research of an improved information gain method using distribution information of terms

This page was built for publication: Improved feature weight algorithm and its application to text classification

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1793568)