个性化智能新闻信息检索系统的设计与实现计算机软件与理论专业论文.docxVIP

摘要信息爆炸式的增加，导致处理和使用这些庞大的信息变得越来越困难。人们 摘要 信息爆炸式的增加，导致处理和使用这些庞大的信息变得越来越困难。人们 在面对“信息过载”和“资源迷向”的问题时，往往显得不知所措。 现行的网络新闻信息检索系统面临很多问题，主要是由于网络上信息的不断 更新，就要求网络新闻信息检索对庞大的动念的信息要做出快速和准确的处理。 同时通用搜索引擎很难满足不同背景，不同目的用户查询要求。为了解决这些问 题，个性化智能搜索引擎应运而生。 为了对有不同兴趣的用户准确地提供网络新闻信息，我们设计了个性化智能 搜索引擎——AI times。AI times系统可以根据用户的不同兴趣返回不同的查询 结果。同时，我们提出了一些改进和创新算法。如：优化的网络爬虫算法，模拟 实验显示更新速度可以比传统的网络爬虫快6倍。基于关键标签的信息抽取算 法，不光可以在最少的人工干预下，提取到有用信息，还同时根据重要性对文档 分类，使网络爬虫可以重点回访和更新那些重要新闻信息。通过查询扩展方法改 进了单一的向量空j’日J模型，最后，我们提出了一个冗余信息推荐算法，模拟实验 表明．该结构和算法能够有效地检索出与用户兴趣相关的信息，并且具有良好的 可适应性。 关键词：个性化：向量空间模型；冗余信息推荐；用户兴趣；Agent II AbstractAs Abstract As the available information increases，the inability to process，assimilate and use such large amount of information becomes more and more apparent．The problems of‘‘the overloading information’’and‘‘the confusing resources’’cause people to feel helpless． Currently available web news retrieval systems face a number of problems in that web—based news retrieval requires the ability to quickly and accurately process and update very large amounts of data that is constantly being updated．It is very difficult to satisfy the user from different background，different intention by general search engine．In order to solve these problems，the personalized search engine appears． In this thesis，we present the design and implementation of Ai-Times，a personalized intelligent search engine the goal of which is to accurately retrieve and organize the web news information for different users according to their interest． Ai-Times can return the search results according to the user interest．This version of Ai—Times introduces the following novel algorithms：A novel optimized crawler algorithm whose fetching-speed is 6 times faster than that of the traditional crawler；A keen tag based extraction algorithm which can extract the data rich content with minimal manual effort and which also allows data to be classified as important or not important SO that the crawler can revisit and update important data；A modified vector