基于internet的中文文本过滤系统的研究与实践-通信与信息系统专业论文.docxVIP

!!!!坠里Research !!!!坠里 Research and Practice of Chinese Text Filtering System Based on Internet ABSTRACT This paper briefly describes the background of text filtering and systematically discusses the relationship of text filtering and text retrieval，machine learning，etc．Taking the example of a kind of typical Chinese text filtering logic model，it studies the related theory and technology that can real ize Chinese text filtering system thoroughly， including concept expansion，Chinese text structure analysis and feature extraction，latent semantic indexing，self—adaptive learning，etc．Then considering the systematic recall，precision，operational efficiency and feasibility，an improved Chinese text filtering system architecture is proposed，the clustering matching modules and the feedback modules of users’ interests are added．The approach of the hybrid Chinese text filtering is explained in detail．In addition，the main mathematical models and the relevant algorithms of the system are put forward． The tentative practice to some functions of the whole system has been carried on using Java technology．In practice，the reverse term frequency database is constructed automatically，and the technique of the keywords’ weight is improved，and the calculating method of the subject sentences’ weight is increased，and the coefficients of the mathematics models are regulated．Furthermore，it has also increased such functions as synonymy expansion and modificatiOn。which obtain certain results． Finally，the precision of filtering is not ideal，so the next contents of thi s subject are summarized systematically and some one’s own views are also presented． Keyword Text representation，Concept expansion，Weight，Vector Space Model， Latent semantic indexing，Machine learning，Text filtering，Chinese text 第一章绪论第一章绪论 第一章绪论 第一章绪论 Internet的迅速发展，已使它成为全球最大的分布式信息库。用户在享受它方 便和快捷的同时，也为它所包含的海量的信息所淹没，往往为了找到自己需要的信 息花费大量的时间和精力。如何能够更有效、更准确地找到自己感兴趣的信息，过 滤出与自己需求有关的信息已成为基于Internet网络信息查询的当务之急。 目前绝大多数的信息均表现为文本方式，因而有关文本处理的各种技术得到极 大