象征性的知识提取数据挖掘.pptVIP

Data Mining on Symbolic Knowledge Extracted from the Web Changho Choi Source: /~dunja/WshKDD2000.html Carnegie Mellon University, J.Stefan Institute Abstract This paper gives a case study of combining information Unstructured Information an errorful source of large amounts of potentially useful information Structured Information less up-to-date, but reliable as facts Using information from two kinds of sources Improves the reliability of data-mined rules Introduction (#1/2) Challenge not only gather and represent knowledge existing on the Web, but also use that knowledge for planning, acting, and creating new knowledge Introduction (#2/2) First stage integrating three types of information gathering Extracting propositional knowledge from highly-structured automatically-generated web pages Extracting propositional knowledge from free-form, unstructured data sources Extracting relational knowledge existing on the Web through a combination of web pages and their hyperlink structure Aim identify patterns of knowledge that were not explicitly represented as facts on the Web Data sources and features Extracted features come directly from crawling the company Web sites e.g. performs-activity, links-to, officers, sector, location, ... Wrapper features from secondary sources rely on a mostly regular format e.g. hoovers-sector, hoovers-industry, hoovers-type, address, ... Abstracted features describe relationships between companies discretize our continuous features e.g. same-state, same-city, share-officers, mentions-same, ... Process of acquiring potentially interesting information about companies from the Web Extracted Features Wrapped Features Abstracted Features Data mining algorithms Discovering associations by applying the Apriori algorithm Learning propositional rules by using the C5.0 algorithm , which generates a decision tree for the given dataset Learning relational rules by using Quinlan’s FOIL system , which can use patterns in the relationship between compani