基于Hadoop的局部支持向量机-pasa.PDFVIP

基于Hadoop 的局部支持向量机 1 2+ 1,2 1 崔文斌 , 温孚江 , 牟少敏 , 浩庆波 1( 山东农业大学 信息科学与工程学院,山东泰安 271018) 2( 山东农业大学 农业大数据研究中心,山东泰安 271018) * Local Support Vector Machine Based on Hadoop 1 2+ 1,2 1 CUI Wen-Bin , WEN Fu-Jiang , MU Shao-Min , HAO Qing-Bo 1(School of Information Science and Engineering,Shandong Agricultural University,Taian 271018) 2(Agricultural Big-Data Research Center,Shandong Agricultural University,Taian 271018) + Corresponding author: Phn: +86 E-mail: msm@ Abstract: With the continuous development of Internet of things, cloud computing technology, The generated data is growing at an explosive rate, How to mining and analysis has become a hot research in the present academic circles in large data . Hadoop distributed computing platform has become the main technology of data analysis. Support Vector Machine is widely used in Data mining , and Local Support Vector Machine was a new classification algorithm that is based on support vector machine. But local support vector machine construct classifier for each test samples, In large data carries on the classification of high time complexity, the classification efficiency is low. In view of the above problems, combined with the Hadoop parallel computing platform, we proposed a local support vector machine algorithm based on Hadoop. This paper makes two improvements on the local support vector machine: the first is that the calculation of k-nearest neighbor for the test sample is parallel, second is the training of model is parallel. We did some tests, and the results show that the local support vector machine based on Hadoop can effectively reduce the classification time, and the classification accuracy of this algorithm