CS276BTextRetrievalandMiningWinter2005.ppt

CS276BText Retrieval and MiningWinter 2005 Lecture 2 Recap: Lecture 1 Web search basics Characteristics of the web and users Paid placement Search Engine Optimization Plan for today Overview of CS276B this quarter Practicum 1: basics for the project Possible project topics Helpful tools you might want to know about Overview of 276B Consider it the “applications” course built on CS276A in Autumn Significant project component Less homework/exams A research paper appraisal that you conduct Application topics that are “current” and that introduce new challenges: Web search/mining Information extraction Recommendation systems XML querying Text mining Topics: web search Initiated in Lecture 1 Issues in web search Scale Crawling Adversarial search Link analysis and derivatives Duplicate detection and corpus quality Behavioral ranking Topics: XML search The nature of semi-structured data Tree models and XML Content-oriented XML retrieval Query languages and engines Topics: Information extraction Getting semantic information out of textual data Filling the fields of a database record E.g., looking at an events web page: What is the name of the event? What date/time is it? How much does it cost to attend Other applications: resumes, health data, … A limited but practical form of natural language understanding Topics: Recommendation systems Using statistics about the past actions of a group to give advice to an individual E.g., Amazon book suggestions or NetFlix movie suggestions A matrix problem: but now instead of words and documents, it’s users and “documents” What kinds of methods are used? Why have recommendation systems become a source of jokes on late night TV? How might one build better ones? Topics: Text mining “Text mining” is a cover-all marketing term A lot of what we’ve already talked about is actually the bread and butter of text mining: Text classification, clustering, and retrieval But we will focus in on some of the higher-level text applications: Extracti