A New Supervised Term Ranking Method for Text Categorization

摘要

In text categorization, different supervised term weighting methods have been applied to improve classification performance by weighting terms with'respect to different categories, for example, Information Gain, χ² statistic, and Odds Ratio. Prom the literature there are three term ranking methods to summarize term weights of different categories for multi-class text categorization. They are Summation, Average, and Maximum methods. In this paper we present a new term ranking method to summarize term weights, i.e. Maximum Gap. Using two different methods of information gain and χ² statistic, we setup controlled experiments for different term ranking methods. Reuter-21578 text corpus is used as the dataset. Two popular classification algorithms SVM and Boostexter are adopted to evaluate the performance of different term ranking methods. Experimental results show that the new term ranking method performs better.