全文搜索引擎的设计与实现本科 江汉大学.docVIP

全文搜索引擎的设计实现设计实现 学士学位论文 论文题目 全文搜索引擎的设计与实现 （英 文） Full-text search engine design and ImplementationNutch 致力于让每个人能很容易, 同时花费很少就可以配置世界一流的Web搜索引擎Abstract Currently, the requirement of customizing and the search engine maintenance is larger and larger. For dealing with such enormous network data, especially, how to store it and access our necessary information has become so significant. However,web search engine can help us to solve this problem well. This?acticle?describes?the?principle?of?full-text?search?engine,and?the?process?for?its?design?and?implementation.?This?system?adopts?Java?Web?platform?with?B/S?model,?and?also?the?relative?frame?of?Nutch,?including?Nutch,Solr,Hadoop,?and?collection?and?inspection?for?whole network?information?based?on?Lucene--the?foundation?of?Nutch.?All?in?all,?this?text?mainly?elaborates?the?backgroud?of?relative?frame,?basical?principle,?and?application?for?Nutch. The?appearance?of?Nutch?related?framework,?makes?that?building?an?personalized?search?engine?based?on?Java?platform?to?be?an?simple?and?reliable?way.?Nutch?is?committed?to?make?everyone?configure?a?word-class?web?search?engine?easily?and?low-costly.At?present,?there?are?many?big?companies?at?home,?like?baidu,?yahoo,?are?using?such?Nutch?relative?frame.??Due?to?the?fact?that?Nutch?is?open-source,?reading?its?source?code?can?let?us?have?a?more?profound?experience?when?realizing?the?search?engine,?and?at?the?same?time,?can?custojmize?the?needed?details?for?realizing?the?seach?engine?deeply. At frist, this article introduces the background of research project. Then, it specifically describes the theoretical knowledge of system and the related theory of framework. Finally, it achieves the system function step by step according to the development method of software engineering. Keywords Nutch、Solr、Hadoop、Lucene、Search Engine 目录 1 绪论 1 1.1 课题背景及介绍 1 1.2 课题研究目的及应用 1 1.3 课题研究范围 1 1.4 小结 2 2 搜索引擎相关理论研究 3 2.1 Web搜索引擎原理和结构 3 2.1.1 搜索引擎三段式工作流程 3 2.1.2 搜索引擎整体结构 4 2.2 网页收集 5 2.1.2 爬虫的工