SOM算法的改进及其在中文文本聚类的应用-计算机应用技术专业论文.docxVIP

摘要 摘要 近儿十年来，因外学者对英文文本聚类投入了大盘研究工作，并取得了一 些优秀的成果。与英文文本驳类相比，中文文本搜类技术研究和应用起步较晚， 文本聚类效果普胞不太理想。针对此现状，本文对中文文本聚类技术进行深入 研究。重点在于改进经典 SOM 算法，并应用于中文文本聚类中。本文研究工作 主要涵盖以下四点内容: ( 1)研究中文文本架炎技术，包括中文分词、停用词过滤、特征选择等中 文预处理技术以及各种疑类分析算法。 (2)针对特征项 t(数灾难导致计算负载过大，在预处现巾引入网义词合并 技术，实现特征空在 IJ 的话义阵饿，提高系统聚炎速度和|准确性。 (3)重点研究经典 SOM 算沽，针对其貌炎数目南预先输入、网络结构固 定、初始化效果不 1虫也!以及挺挺结果依赖样本输入 JII贝序，提出…手中改 ill 的自增 长 SOM 算法予以解决之。 (4) 采用 C#.net 技术设计实现了基于改础的 SOM 算法的《中文文本聚类 系统》平台。然后边行了系统测试砰仙，评估结果表明改进 SOM 算法可以改器 系统聚炎效果。 关键词:文本聚类; SOM; 中文分词:同义词合并;特征 j在拌:预处理 Abstract Abstract In recent years，toreign scholars have done a lot research ，and made som olltstanding results on the English text Iustering. Compared with thc English text clustering，Chinese text clustering technology research and application started more lately，and text c1ustering rcsults in general is not very satistàctory. For this situation， this paper had some depth stlldy of Chinese text c1ustering techniques. lt foclIsed on improving SOM clustering algorithm，and applied to Chinese text cIustering. It started work in the following aspects: ( 1) Explored the Chinese text clustering technologies ，including Chinese pretrcatment sl1ch as Chinese word segmentation ，Stop words filter，and Feature selection and so on and a variety 01commonly used c1ustering algorithm. 丁he curse of dimensionality tor featllre items wOl1ld cause the large calculation load. So in the Chinesc pretreatment it introd l1ced synonyms merger technology，to achieve to reduce Feature space dimension and improve speed and accuracy of clustering. Explored SOM neural network theory and analyze its defects.Beacllse its Number of c1usters to be pre input ，fixed network and unsatisfàctory initialization result ，this paper proposed an improved and growthself SOM algorithm to solve these problems. Using C#.Net technology designed and implemented a Chinese 丁ext Clustering System platform with both research and application value.And then condllcted a systematic te