一种面向不完全标记的文本数据流自适应分类方法.PDF

Vo 1. 43 No. 12 第 43 卷第12 期 计算机科学 2016 年 12 月 Computer Science Dec 2016 一种面向不完全标记的文本数据流自适应分类方法 张玉红陈伟胡学钢 (合肥工业大学计算机与信息学院 合肥 230009) 摘 要 现实生活中网络监控、网络评论以及微博等应用领域涌现了大量文本数据流，这些数据的不完全标记和频繁 概念漂移给已有的数据流分类方法带来了挑战。为此，面向不完全标记的文本数据流提出了一种自适应的数据流分 类算法。该算法以一个标记数据块作为起始数据块，对未标记数据块首先提取标记数据块与未标记数据块之间的特 征集，并利用特才正在两个数据块间的相似度进行概念漂移检测，最后计算未标记数据中特征的极性并对数据进行预 测。实验表明了算法在分类精度上的优越性，尤其在标记信息较少和概念漂移较为频繁时。 关键词 不完全标记，自适应，数据流，概念漂移 中固法分类号 TP181 文献标识码 A DOI 10. 11896/j. issn. 1002-137)♀ 2016.12.032 Self-adaptation Classification for Incomplete Labeled Text Data Stream ZHANG Yu-hong CHEN Wei HU Xue-gang (School of Computer and Information ,Hefei University of Technology ,Hefei 230009 ,China) Abstract In the real-world applications ,a large nwnber of text data stream are emerging , such as network monitoring , network comments and microblogs. However ,these data have incomplete labels and frequent concept drifts ,which have brought many challenges to existing classification methods of data stream. Thus we proposed a seH-adaptation classifi cation algorithm for incomplete labeled text data stream in this paper. The proposed algorithm uses a labeled data chunk as the starting one ,and extracts features between the labeled data chunk and the unlabeled data chunk. Meanwhile ,for unlabeled data chunks ,it uses the similarity of features between two data chunks to test concept drift Finally ,the polari ty of features of the unlabeled data chunks is calculated to predict the instances. The experimental results show our al gorithm can improv