基于影响函数的k-近邻.pdfVIP

第37 卷第7 期 电 子 与 信 息 学 报 Vol.37 No.7 2015 年7 月 Journal of Electronics Information Technology Jul. 2015 基于影响函数的k-近邻分类 职为梅* 张 婷 范 明 (郑州大学信息工程学院 郑州 450052) 摘 要：分类是一种监督学习方法，通过在训练数据集学习模型判定未知样本的类标号。与传统的分类思想不同， 该文从影响函数的角度理解分类，即从训练样本集对未知样本的影响来判定未知样本的类标号。首先介绍基于影响 函数分类的思想；其次给出影响函数的定义，设计3 种影响函数；最后基于这3 种影响函数，提出基于影响函数的 k-近邻(kNN)分类方法。并将该方法应用到非平衡数据集分类中。在18 个UCI 数据集上的实验结果表明，基于影 响函数的k-近邻分类方法的分类性能好于传统的k-近邻分类方法，且对非平衡数据集分类有效。 关键词：数据挖掘；监督学习；非平衡数据集分类；影响函数；k-近邻 中图分类号： TP181 文献标识码： A 文章编号：1009-5896(2015)07-1626-07 DOI: 10.11999/JEIT141433 k-nearest Neighbor Classification Based on Influence Function Zhi Wei-mei Zhang Ting Fan Ming (College of Information Engineering, Zhengzhou University, Zhengzhou 450052, China) Abstract: Classification is a supervised learning. It determines the class label of an unlabeled instance by learning model based on the training dataset. Unlike traditional classification, this paper views classification problem from another perspective, that is influential function. That is, the class label of an unlabeled instance is determined by the influence of the training data set. Firstly, the idea of classification is introduced based on influence function. Secondly, the definition of influence function is given and three influence functions are designed. Finally, this paper proposes k-nearest neighbor classification method based on these three influence functions and applies it to the classification of imbalanced data sets. The experimental results on 18 UCI data sets show that the proposed method improves effectively the k-nearest neighbor generalization ability. Besides, the proposed method is effective