基于机器学习的主题Web挖掘技术-计算机软件与理论专业论文.docxVIP

山东师范大学硕士学位论文法的基础上，加入了内容相关度的计算，提出了一种新的计算页面重要性的算法 山东师范大学硕士学位论文 法的基础上，加入了内容相关度的计算，提出了一种新的计算页面重要性的算法 一嚣HITS算法。 4．本文设计了基于机器学习的主题Web挖掘系统，并对各个模块的作用进行了 介绍。该系统能够根据用户的查询请求进行页面收集，对收集到的页面计算其重 要性，最后把主题相关且重要的页面反馈给用户。同时，可根据用户的反馈信息， 进行进一步的系统调整。 关键字：Web挖掘；机器学习；主题爬虫；HITS 分类号：TP391 山东师范大学硕士学位论文The 山东师范大学硕士学位论文 The Technology of Topical Web Mining Based on Machine Learning With the web information resources emerge abruptly，how to get those potential and valuable information from network has attracted people’s more and more attention．Confronted with this huge， heterogeneous and semi—structural information repository，Web surfers often have to spend a lot of time and efforts to find information needed，and even that they may fail in many cases；Topical Web Mining is a new research direction in recent years，which provides a new research direction． The main contributions of the thesis can be sumnrized as follows： 1．This article studies and analyses Web Mining and Machine Learning．Web Mining is divided into three branches by different objects：Web Content Mining、Web Structure Mining、Web Usage Mining．According to the distribution of the topic Web pages on the web，Topical Web Mining collects Web pages which are related to the topic theme and analyses，handles them by intellectual ways．Machine Learning is an important branch of the field of artificial intelligence．This paper presents the model of Machine Learning,classification，and the development process。Meanwhile，№chine Learning in the field of Web Mining application is described． 2．Web crawler is a kind of recursive traversal web automation program which can download web pages and analysis these content．How to control the crawler’s crawling strategy effectively is one of the most important factors which influence Web Mining．In the light of Machine Learning，and using the negative example study theory，we advance a new crawler’s crawling strategy．The experimental results show that this strategy can increase the harvest rate of inquiries． 3．The calc