kdd-tutorial-CMUComputerScience.ppt

Andrew McCallum, Just Research Information Extractionand Integration: an Overview William W. Cohen Carnegie Mellon University April 26, 2004 Example: The Problem Example: A Solution Extracting Job Openings from the Web What is “Information Extraction” What is “Information Extraction” What is “Information Extraction” What is “Information Extraction” What is “Information Extraction” What is “Information Extraction” Tutorial Outline IE History Landscape of problems and solutions Models for named entity recognition: Sliding window Boundary finding Finite state machines Overview of related problems and solutions Association, Clustering Integration with Data Mining IE History Pre-Web Mostly news articles De Jong’s FRUMP [1982] Hand-built system to fill Schank-style “scripts” from news wire Message Understanding Conference (MUC) DARPA [’87-’95], TIPSTER [’92-’96] Early work dominated by hand-built models E.g. SRI’s FASTUS, hand-built FSMs. But by 1990’s, some machine learning: Lehnert, Cardie, Grishman and then HMMs: Elkan [Leek ’97], BBN [Bikel et al ’98] Web AAAI ’94 Spring Symposium on “Software Agents” Much discussion of ML applied to Web. Maes, Mitchell, Etzioni. Tom Mitchell’s WebKB, ‘96 Build KB’s from the Web. Wrapper Induction Initially hand-build, then ML: [Soderland ’96], [Kushmeric ’97],… Citeseer; Cora; FlipDog; contEd courses, corpInfo, … IE History Biology Gene/protein entity extraction Protein/protein fact interaction Automated curation/integration of databases At CMU: SLIF (Murphy et al, subcellular information from images + text in journal articles) Email EPCA, PAL, RADAR, CALO: intelligent office assistant that “understands” some part of email At CMU: web site update requests, office-space requests; calendar scheduling requests; social network analysis of email. IE is different in different domains! Landscape of IE Tasks (1/4):Degree of Formatting Landscape of IE Tasks (2/4):Intended Breadth of Coverage Landscape of IE Tasks (3/4):Complexity Land