一种数据驱动的wrapper自动生成和维护方法.pdfVIP

第 43 卷 增刊 计 算 机 研 究 与 发 展 Vol.43, Suppl. 2008 年 11 月 JOURNAL OF COMPUTER RESEARCH AND DEVELOPMENT Nov. 2008 一种数据驱动的 Wrapper 自动生成与维护方法 王仲远 艾静 孟小峰 ( 中国人民大学信息学院 北京 100872) (zhywang@) 摘要 Wrapper 的生成与维护是Deep Web 数据集成中一项非常重要的研究课题.传统的方法通常是通过对网页结构或特征的分析 来推导 Wrapper,这种方法严重依赖于网站模板,在处理某些网站时可能完全失效.同时,以往研究对于 Wrapper 的维护问题关注较 少.这两个问题导致无法真正实现大规模Deep Web 数据集成.本文提出了一种新颖的数据驱动的Wrapper 自动生成与维护方法.这 种方法利用同一领域不同网站之间,以及同一网站不同版本之间的语义关系,通过数据项的匹配,来生成和维护 Wrapper.本文的方 法没有模板依赖的问题,无需设置阀值.经过大量实验证明,此方法在准确性与适用性上,与原有方法相比有较大提高. 关键词 Deep Web;数据集成;Wrapper生成;Wrapper维护 中图法分类号 TP391 A Data Driven Approach for Automatic Wrapper Generation and Maintenance Wang Zhongyuan, Ai Jing, Meng Xiaofeng (School of Information, Renmin University of China, Beijing, 100872) Abstract Wrapper generation and maintenance is a crucial research topic in Deep Web data integration. Existing methods usually induced Wrappers by structures or features analyzing of the website. However, these methods rely heavily on website templates and may be ineffective for some websites. Moreover, previous research paid less attention to wrapper maintenance. These two problems block the implement of large-scale Deep Web data integration. This paper proposes a novel method to perform this issue automatically, which is called data driven approach. This approach matches date items between source pages and target pages by the same semantic record of different websites in one domain or different templates in one site. Then it generates or maintains wrappers with these mapping data items. This approach doesn’t rely on the template or set thresholds. Experimental results show that the accuracy and applicability of the method has improved greatly compared with the previous methods. Key words Deep Web; Data Integration; Wrapper Generation; Wra