搜索引擎设计本科生毕设论文.docVIP

摘 要 随着互联网的迅速发展，网络规模不断扩大，信息储量急剧增长，搜索引擎技术越来越得到广泛地使用。 本文通过对各种通用搜索引擎的关键技术进行研究，完成了对通用WEB搜索引擎的设计与实现。搜索引擎系统包括3个功能模块：网页获取模块，数据存储模块和检索模块。本人在课题组中主要承担工作有：系统整体设计、数据库的设计实现以及中文分词系统的设计实现。 本系统的整体设计突出操作简便、功能强大、人性化设置、并行处理可移植等特点，其中中文分词，各模块的存储流程是系统的设计亮点。本文中对搜索引擎的各种技术算法进行了介绍，而且根据系统的需要进行了各功能模块的设计。数据库设计的特点是：大容量存储、高效检索和简单查询。索引数据库以页面信息表和词库表为核心，通过对词创建索引以提高检索效率；中文分词系统采用JDK平台开发，实现对中英文句子的分割，使其分为单独的词或词组。 关键词:搜索引擎；WEB搜索；中文分词；索引数据库；排序。 Abstract With the rapid development of the internet, the constant expansion of the network size, the run-up growing of the information storage, the technology of the search engine is becoming more and more popular. The article accomplish the design and realization of the general WEB search engine through the studying of all kinds of the general search engine. The search engine system includes three functions modules. They are Homepage gain module, data storage module and retrieval module. My main duty in this topic research is overall System design, database design realization, Chinese participle system design realization. The prominent point in this overall system is that operation is simple, the function is formidable, the human nature establishment, the parallel processing may transplant and so on, especially the Chinese participle and each memory operation module. The article does not only introduce all kinds of technical algorithm in the search engine, but design each function module according to the need of the system. The database design characteristic is: Large capacity memory, highly effective retrieval, simple inquiry. The index database takes the page information table and the word storehouse table as a core, enhancing the searches efficiency through establishing the words index. Chinese participle system uses the JDK platform exploitation, realization to the Chinese and English sentence division, causes it to divide into the independent word or the phrase. Keywords: WEB search; Chinese participle; Index database; Arranges 目 录 1 绪论 1 1.1 研究的背景及意义 1