毕业论文：《网页文本信息抽取的设计与实现》.doc

HUNAN UNIVERSITY 毕业设计（论文） 设计（论文）题目： 网页文本信息抽取 设计与实现 学生姓名 网页文本信息抽取设计与实现 摘 要 随着互联网的普及和应用，其蕴含的信息和内容也越来越多,包括结构化的、半结构化的和非结构化的信息。因此，为了能应对信息爆炸带来的问题和挑战，对各式各样的文本信息进行抽取，迫切需要一些技术帮助人们在海量信息中快速找到自己真正需要的信息。 网页文本抽取实现技术正是解决这个问题的一种方法。 本文以传统的信息抽取理论和方法为基础，实现了一种基于XML特征的网页文本抽取方法。本文中，研究了一般网页的特征，实现了一种基于XML标签特征的网页提取方法，先对网页进行HTML页面标准化，再转成XML语言，并且根据XML语言的特点，对其内部语言进行转化，从GB转为UTF，并对其进行标准化，然后通过熟悉XML标签的各种特性，对网页文本根据标签进行抽取。最后，对该抽取方法进行测试和评估，并总结出该方法的优点以及可以改进的地方。 关键词：互联网；信息抽取；HTML；XML；文本信息抽取；标签 Design and Implementation of Text Information Extraction from Web Pages Abstract As Internet becoming more and more popular in our daily life, it has played an important role in providing us with all kinds of information, which includes structural information, semi-structural and non-structural ones. In order to deal with the problems and challenges of the information explosion, some new methods to extract information are urgently needed to help people get the exact data they want from a mass of information. And here is a way to do so. Based on the traditional theory and algorithm of Information Extraction, this paper puts forward an arithmetic implementing the extraction function for the text of a web page with the use of XML features and machine learning. This arithmetic analyses the common features of a web page and posts a new way to extract text information based on the specific features of XML tags, which actually standardizes the HTML page first, and then converts it into XML page with the changing from GB to UTF, and standardizes it too. After that, it can extract the text data out of the web page by the different use of the XML tags. Last but not least, the paper shows the results of testing of the arithmetic and its evaluation, with a conclusion of its advantages and what needs to be improved. Key Words: Internet; HTML; XML; Text Information Extraction; Tags  目 录 TOC \o 1-3 \h \z \u 1 绪论 h 1 1.1课题背景及目的 h 1 1.2课题研究现状 h 3