textrank关键词提取算法与som文本聚类模型的优化研究计算机应用技术专业论文.docxVIP

RESEARCH RESEARCH oN THE oPTIMIZATIoN oF TEXTRz州K K-EYWroRD EXTRACTIoN ALGoRITHM AND SoM TEXT CLUSTER矾G MoDEL ABSTRACT With the rapid development of internet information technology,text clustering has gradually become the focus of people’S research in order to meet the requirements of the vast network of text information retrieval．Keyword extraction and clustering algorithm play all important role in the process of text clustering．To improve the text clustering effect，this paper carries on the research from two aspects： 1．An improved TextRank keyword extraction algorithm is proposed for text preprocessing．Term mutual information based on sliding window,as the edge weight，will be added to the graph model of TextRank algorithm,optimized the candidate words score distribution of TextRank．And then，put vertex weight-single document term frequency(Term Frequency，TF)into the TextRank’S weight iteration formula．The term frequency is used to adjust the probability of word’jumping¨，to certain extent，the problem of equal probability’jumping¨is solved．The experimental results show that the presented algorithm’S precision，recall ratio and F 1-measure have been improved， the iterative calculation efficiency have enhanced by 20％．Extracted keywords II 万方数据 have have more representatives to the text feature，and benefit to improve the subsequent text clustering effect． 2．Bayesian regularization theory is introduced to Self-Organizing Map text clustering algorithm,during the weight adjustment process，the penalty term that reflects the complexity of the network weights is added to the weight adjustment formula，thereby avoid overfitting；Bayesian inference is used to obtain the optimal hyper parameters in the weight adjustment formula，SO that the network weights distribution and input data probability distribution become more consistent during the iterative training，in order to improve the text clustering effect．The experimental results on UCI and Chinese text dataset show that compar