基于Hadoop的文本挖掘研究与应用-控制理论与工程专业论文.docxVIP

广东工业大学硕士学位论文AB 广东工业大学硕士学位论文 AB STRACT With the rapid development of Internet technology,network information has become the main source of information for people to obtain information．People can easily get massive information through Internet，but the explosive growth of information also brings some inconvenience．It is more and more difficult for users to quickly and effectively filter out acquire the valuable information in the face of from massive data．In front of massive data,the traditional single node serial computing model has failed to meet the requirements of vast amounts of information processing，distributed technology therefore brings the new solutions，through the distributed parallel processing mode，the massive data calculation can be completed quickly and efficiently the massive data calculation．At present，the present oloud computing which is originated from distributed calculation has obvious advantages in dealing with massive data and high concurrency problems． Recent years，Hadoop has become a cloud platform that is popular in application， the application of the cloud platform，its hardware can be constructed by common PC cluster and therefore more economic，meanwhile，it supports storage and processing of massive data．Text mining is a heated branch of data mining，which is widely used in the fields of search，classification，recommendation and SO on．The conventional serial computation mode is applied in the current text mining area，and it is difficult to meet the requirements of the massive text data．Based on this，this paper combines Hadoop platform with text mining technology．This paper focuses on the research of Hadoop text preprocessing and CURE clustering algorithm．The main work of this paper includes the following： (1)Briefly introduce the research background and significance，distributed technology,cloud platform and text mining and other related technologies． (2)Research on the text pretreatment process of text mining，put forward a new method of con