基于Spark云计算平台的改进K近邻算法研究-计算机技术专业论文.docxVIP

Abstract Abstract With the rapid development of the modelTl era of the Internet，people have gradually entered the era of big data．In the face of an array of data，the user how to quickly find information to meet their own needs to become a hot research problem in urgent need of the academic community．Internet risers efficiently tap the information requirements more stringent than forward．Data mining methods can be achieved from massive data efficiently dig out accurate data．Data mining classification algorithms to predict trends in the data，we recommend an effective means to meet the wishes of the user data Wherein，K nearest neighbor classification algorithm is the large—scale spatial data query data mining one common classification algorithm．Through cloud computing platform may further increase the operating speed of data mimng．Spark cloud computing platform is further optimized Hadoop cloud-based platform．Unlike Hadoop HDFS file system is totally dependent，Spark possible to handle data in memory set to further improve the data processing speed of the cloud platform． For users to quickly access the information needs，this paper on the Spark cloud computing platform，the use of parallel improved K nearest neighbor classification algorithm to achieve the goal of providing users with the recommended data quickly This paper puts forward two points：first，this paper improves the K nearest neighbor classification algorithm index creation technology，and improves the efficiency of the algorithm tO find the nearest neighbor data points．The traditional K nearest neighbor classification algorithm is the main control factor is to find the neare st neighbor data point efficiency is low，Tree K nearest neighbor is applied to the Kd classification algorithm index to create the search efficiency of the data structure．The running efficiency of Tree Kd is mainly in the process of the nearest neighbor search for non—leaf nodes．In this paper，by optimizing the KD tree to be classified dat