基于Lucene的垂直搜索引擎系统设计与实现论文.docVIP

摘要 搜索引擎为人们在拥有海量信息的互联网上查找信息资源提供了方便。但网络信息资源的“爆炸”式增长使得人们获取有用信息变得日益困难，为此人们开始更多地关注如何快速有效地从海量的网络信息中抽取出潜在的、有价值的信息，使之有效地在管理和决策中发挥作用。针对这种情况，需要一个专注于特定领域、对硬件要求较低、数据全面深入、更新及时的搜索引擎系统。近几年来面向特定领域搜索引擎的研究与应用己经成为搜索技术的一个较热研究方向；而针对某一领域、某一特定人群或某一特定需求建立的搜索引擎我们称之为垂直搜索引擎。 本文介绍对比Lucene与关系数据库的区别。ABSTRACT Search Engine provides a convenient way for searching information resource in the network which owns magnanimous information. But as network information resource is growing within “explosion mode”, people get useful information more and more difficultly; then people begin to give more attention to how to extract latent and valuable information quickly and efficiently from the magnanimous information, so as to use it efficiently to make effects in the management and decision. To resolve this problem, we need a search engine system which faces to the special area, needs low hardware configuration, can analyze the depth of the data and is updated timely. In recent years, the research and application of the search technology which faces to the special area has become a hot research direction. We call a search engine which faces to the special area, people and command just vertical search engine. This article will give the introduction of the vertical search engine, then make a analysis of the Lucene’s index and retrieval technology by an open packet, and compare the Lucene and the relational database. We will clarify its application through the mobile-phone vertical search engine based on JAVA which is based on Lucene’s retrieval architect, use Spring frame, contains web crawler technology like Heritrix and Ajax etc. Keywords: Lucene;Vertical Search Engine;Web Crawler; Chinese Word Segmentation;Retrieval 目录 摘要 I ABSTRACT II 第1章 引言 1 1.1 课题的背景及意义 1 1.2 系统简介 1 1.3 课题的主要工作及论文的组织 2 第2章 垂直搜索引擎系统 3 2.1垂直搜索引擎概述 2.1.1 垂直搜索引擎的概念及特点 3 2.1.2 垂直搜索引擎的优势及现状 3 2.2 垂直搜索引擎工作原理 4 2.2.1 系统基本结构与原理 4 2.2.2 系统组件介绍及相关技术 5 2.3 本章小结 7 第3章 全文检索引擎LUCENE分析与研究 8 3.1 Lucene概述 8 3.1.1 Lucene的组织结构 8 3.1.2 Lucene的优点 9 3.