基于bdb的xml信息检索引擎平台设计与实现-信息管理与信息系统专业论文.docxVIP

ABSTRACT With the development of large Internet data, the traditional HTML information retrieval cant meet the information demand which is always changing. As the standard of exchange and represention of Internet data, XML has much advantage. So its more and more important, and will probably replace HTML. Its urgent to solve the problem of mining effective information from a large number of XML. Then XML information retrieval will be the key technology for people to know and make use of XML information. So I will design and test a platform of XML information retrieval engine based on BDB. It will be used for the purpose of the research of XML retrieval. In this paper, we design and implement two XML retrieval algorithms based on different storage scheme, which are XObject retrieval algorithm for multi-documents and SLCAOffset retrieval algorithm, to provide the algorithm support for this XML retrieval platform. In XObject algorithm, we utilized the embedded Berkeley DB as the background database, which performed one time better than the traditional relational database. Then we use VTD-XML mechanism to parse XML documents and come up with the XML structural cluster algorithm base on Trie tree match whose cluster performance are better than popular cluster algorithm; in addition, we propose an tree parent storage schema to optimize the cluster structural information storage; finally we dynamically constructed the query path, executed XQuery on BDB XML and stored the returned results; In SLCAOffset algorithm, we designed and implemented the format of token record based on BDB and the block storage schema of XML document; then we come up with the offset concept to solve the problem that XML documents consume too much space; furthermore, we get the returned object node by realizing the node aggregation algorithm; finally we read the result segments from the documents block by the recorded offset and sort the segment. In result analysis, we conducted an experiment on the