基于类内频率的文本分类特征选择方法.pdfVIP

第28 卷 第17 期 计算机工程与设计 2007 年9 月 V ol . 2 8 N o . 17 Computer Engineering and Design Sept. 2007 基于类内频率的文本分类特征选择方法 1 2 崔彩霞 ， 王素格 (1. 太原师范学院计算机系，山西 太原0300 12 ；2. 山西大学数学科学学院，山西 太原030006) 摘 要：随着计算机技术和WWW 的飞速发展，文本分类已经成为信息检索的关键技术之一，而特征选择对分类效果起着至 关重要的作用。对文本分类的 种常用特征选择方法进行了介绍和分析，提出了一种基于类内频率的特征选择方法。选用 4 法和支持向量机作为分类器，利用以上 种文本特征选择方法在平衡语料和非平衡语料上进行了测试。实验结果表明， kNN 5 该方法能够有效选出真正对分类有意义的特征，分类效果较好，尤其适合支持向量机分类器。 关键词：文本分类 特征选择 文档频率 信息增益 互信息 ; ; ; ; 中图法分类号： 文献标识码： 文章编号： ( ) TP391 A 1000-7024 2007 17-4249-03 Feature selection method for text categorization based on frequency in kind CUI Cai-xia1, WANG Su-ge2 (1. Department of Computer, Taiyuan Normal University, Taiyuan 0300 12, China; 2. College of Mathematics Scientific, Shanxi University, Taiyuan 030006, China) ： Abstract With the development at full speed of the technology of the computer and WWW, text categorization had become one of the key technologies of information retrieval, and feature selection played a very important role to categorization result. Four common feature selection methods in text categorization are introduced and analyzed. And a feature selection method based on frequency in kind is pro- posed. Then combined with the kNN and the support vector machine, the test of five methods is carried out on the balance language ma- terial and non-balance language material. The experiment result indicates that the method can select meaningful features and has a better