全文检索技术研究与应用论文.docVIP

摘 要 全文检索是现代信息检索技术的一个非常重要的分支，它是处理非结构化数据的强大工具，也是搜索引擎的核心技术之一。本文对中文全文检索的有关技术进行了较为深入的研究。在基于字表的全文索引方面，本文提出了一种改进的倒排索引结构，同传统索引结构相比，更便于索引的构建、维护、更新。本文的重点放在了全文检索技术的应用上，对如何利用新技术、改善检索系统的结构、提高检索系统的性能和效率、加快检速度、不断适应网络信息发展等方面做了重点研究。 全文检索是一种IO密集型的应用，以往的全文检索系统的开发多在关系数据库的基础上进行。本文针对全文数据库的特点，深入讨论此法弊端与不足，并提出了在文件系统上构建的解决方案。由于目前全文检索系统的开发平台并不多见，本文介绍了一种全文检索引擎工具包一Lucene，它功能强大，小巧精悍，便于嵌入各种应用。近年在世界各地被广泛使用，诸如IBM等公司都使用其核心代码。作为一个开源软件，它为我们学习搜索引擎的核心技术提供了绝佳的机会，对其剖析研究、进行二次开发，是一件很有意义的事情。 在应用方面，本文主要工作是本校学位论文全文数据库的设计与实现。 关键字：全文检索 倒排文件 Lucene 全文数据库 自动分词 THE RESEARCH AND IMPLEMENTATION OF FULL-TEXT RETRIEVALSYSTEM （ABSTRACT） Full-text retrieval is an important information retrieval technology. It is a powerful tool fordealing with nonstructural data, and is one of the key technologies of the search engine. This paper deeply research on Chinese full-text retrieval technology. In the filed of full-text index based on word inverted table, a improved word-based Chinese inverted index structure is proposed which has a better performance than traditional approaches, and convenient for constructing, maintaining and updating index. According. to its characteristic, we design its corresponding optimized search method. Analysis shows that better dynamic performance and high indexing speed is possible using this structure. This paper pays more attention in application of full-text retrieval technologies. How to use new technique, optimize the structure of retrieval system, improve performance and efficiency, quicken search speed and adapt the development of current web is also discussed in this paper. Full-text retrieval is an I/O intensive application.. Its previous developments are carried on the basis of relation database. This paper deeply discusses the abuse and deficiency of this mode according to its characteristic. Because the development platform of full-text retrieval is absent currently, Lucene, a full-text search engine toolkit, is introduced into the paper. It has powerful performance. and