序列最小优化工作集选择算法的改进.pdfVIP

第42 卷 第3 期 电 子 科 技 大 学 学 报 Vol.42 No.3 20 13年5月 Journal of University of Electronic Science and Technology of China May 20 13 序列最小优化工作集选择算法的改进 左 琳 ( 电子科技大学能源科学与工程学院 成都 611731) 【摘要】序列最小化算法(SMO)是支持向量机重要的常用分解方法。而工作集的选择是实现序列最小优化算法的关键。 通过重写KKT条件，提出了一种改进的新工作集选择方法，并相应提出最小化步骤。通过将改进的支持向量机方法应用于网 络用户行为数据的分析，与现有方法进行对比测试，验证了新工作集选择方法将减少支持向量机的学习时间并加快收敛过程， 改进的支持向量机方法在运行效率和准确度上都有不同程度的提高。 关 键 词 改进; KKT条件; 序列最小优化; 支持向量机; 工作集选择 中图分类号 TP31 文献标志码 A doi:10.3969/j.issn.1001-0548.2013.03.025 Improvement of Working Set Selection for SMO Method ZUO Lin (School of Energy Science and Engineering，University of Electronic Science and Technology of China Chengdu 611731) Abstract Support Vector Machine (SVM) as a machine learning method has rigorous theoretical basis and been used widely in engineering practices. How to improve the convergence speed of SVM is the hot research topic. Sequential Minimal Optimization (SMO) algorithm is an important decomposition method for SVM, in particularly, the working set selection algorithm is the key part for SMO. In most cases, the working set selection is selected directly based on the KKT conditions, but in some situations, the conventional selection method can’t avoid the shortcoming resulting from random selection, even can’t satisfy with the KKT conditions. In this paper, the condition of working set selection is improved by rewriting the KKT conditions, and a set of new steps for minimizing SMO sub-problem is proposed accordingly. The improved method is used to analyze the users’ online behaviors, by comparing with the existin