文本文件倒排文档系统设计.pdfVIP

文本文件倒排文档系统设计 摘 要 信息海量的增长，促生了信息检索技术，尤其是文本信息检索技术发展。为 了找到所需信息，人们迫切需要一个高效的检索工具。倒排文档可以节约检索时 间，成为了信息检索技术研究热点。 文本信息检索主要有以下几种建索引模型：正排表、倒排表、后继树等。根 据各种模型在实际应用中的比较，倒排表最为实用，应用范围也较为广泛，本文 将其原理应用在中文信息检索索引建模中。 本文设计中文文本文件倒排文档系统。在对主流索引模型进行比较基础上， 采用了倒排表索引模型。倒排文档的建立过程分别为：文本预处理（ 数据读入、 分词、排除停用词）、建立正向表、根据正向表建立倒排表、倒排表的合并更新， 生成倒排文档等步骤。利用排除停用词的方法来节省存储空间、减少检索时间。 同时，也对建立倒排文档的相关技术进行了叙述。 关键词：文本检索，倒排表，倒排文档，索引模型 I 文本文件倒排文档系统设计 ABSTRACT Massive growth in information promotes the information retrieval technology, especially text information retrieval. In order to find the necessary information, people urgently need an efficient search tools. How to efficient save storage and retrieval time become a new research focus of information retrieval technology. Text information retrieval is based on the following construction index model: Forward Index, inverted index, suffix tree and so on. Comparison with these models in the practical application of comparison shows that inverted index is more practical, and the scope of application is wider. This article designed an inverted index system based on Chinese text documents using inverted index model. The process of inverted document is: text pretreatment (reading data, the word, excluding stop words), building forward index, build inverted index, inverted-index updating, generating inverted documents, and other steps. Use stop-word list to save storage space and retrieval time. Also introduce the use of GB code on the system. At last introduce other technologies of inverted index. Key words: Text search，Inverted index，Inverted documents，Index Model II