基于NSVM的核空间训练数据减少方法.pdfVIP

42 4 Vol.42 No.4 第 卷 第 期 电子科技大学学报 2013 7 Journal of University of Electronic Science and Technology of China Jul. 2013 年 月 基于NSVM的核空间训练数据减少方法 王 晓，刘小芳 (四川理工学院计算机学院 四川 自贡 643000) 【摘要】针对核空间中大数据集的计算代价高问题，提出用NSVM 方法减少分类器的训练数据。先用NSVM 、核主成分 分析(KPCA)和贪婪KPCA分别从全部训练数据中提取训练分类器的子集；再用子集训练分类器，并用训练和测试数据的错分 率对分类结果进行评价。在两个数据集和两种分类器中，用KPCA提取的子集训练的分类器的分类性能弱于NSVM 和贪婪 KPCA ，但用贪婪KPCA提取的子集训练的分类器的泛化能力弱于NSVM 。仿真结果表明，用NSVM 方法提取的子集训练的分 类器，不仅保证了分类器的泛化能力，也降低了分类算法的计算复杂度。 关 键 词 分类器; 贪婪核主成分分析; 核主成分分析; 非线性支持向量机; 支持向量; 训练数据 中图分类号 TP391 文献标志码 A doi:10.3969/j.issn.1001-0548.2013.04.012 Nonlinear Support Vector Machine for Training Data Reduction in Kernel Space WANG Xiao and LIU Xiao-fang (School of Computer Science, Sichuan University of Science and Engineering Zigong Sichuan 643000) Abstract Aiming at the high computational cost issue for large data sets in kernel space, the non-linear support vector machine (NSVM) is proposed to reduce training data of classifier. First, a subset of training classifier is extracted from full training data by using NSVM, kernel principal component analysis (KPCA), and greedy kernel principal component analysis (GKPCA), respectively. Then, the classifier is trained by those subsets, respectively. Finally, the classification results are evaluated by the error rate of the training and test data. The classification performance of the classifier trained by the subsets from the KPCA method is inferior to those of from the NSVM and