learning to construct knowledge bases from the world wide web（学习从万维网构建知识库）.pdfVIP

Artificial Intelligence 118 (2000) 69–113 Learning to construct knowledge bases from the World Wide Web Mark Craven a, Dan DiPasquo a , Dayne Freitag b , Andrew McCallum ab , Tom Mitchell a , Kamal Nigam a , Seán Slattery a a School of Computer Science, Carnegie Mellon University, 5000 Forbes Avenue, Pittsburgh, PA 15213-3891, USA b Just Research, 4616 Henry Street, Pittsburgh, PA 15213, USA Received 30 October 1998; received in revised form 2 June 1999 Abstract The World Wide Web is a vast source of information accessible to computers, but understandable only to humans. The goal of the research described here is to automatically create a computer understandable knowledge base whose content mirrors that of the World Wide Web. Such a knowledge base would enable much more effective retrieval of Web information, and promote new uses of the Web to support knowledge-based inference and problem solving. Our approach is to develop a trainable information extraction system that takes two inputs. The first is an ontology that defines the classes (e.g., company, person, employee, product) and relations (e.g., employed_by, produced_by) of interest when creating the knowledge base. The second is a set of training data consisting of labeled regions of hypertext that represent instances of these classes and relations. Given these inputs, the system learns to extract information from other pages and hyperlinks on the Web. This article describes our general approach, several machine learning algorithms for this task, and promising initial results with a prototype system that has created a knowledge base describing university people, courses, and research projects.  20