Data Mining – Intro数据挖掘–简介.pptVIP

Data Mining – Intro Course Overview Spatial Databases Temporal Databases Spatio-Temporal Databases Data Mining Data Mining Overview Data Mining Data warehouses and OLAP (On Line Analytical Processing.) Association Rules Mining Clustering: Hierarchical and Partitional approaches Classification: Decision Trees and Bayesian classifiers Sequential Patterns Mining Advanced topics: outlier detection, web mining What is Data Mining? Data Mining is: (1) The efficient discovery of previously unknown, valid, potentially useful, understandable patterns in large datasets (2) The analysis of (often large) observational data sets to find unsuspected relationships and to summarize the data in novel ways that are both understandable and useful to the data owner What is Data Mining? Very little functionality in database systems to support mining applications Beyond SQL Querying: SQL (OLAP) Query: - How many widgets did we sell in the 1st Qtr of 1999 in California vs New York? Data Mining Queries: - Which sales region had anomalous sales in the 1st Qtr of 1999 - How do the buyers of widgets in California and New York differ? - What else do the buyers of widgets in Cal buy along with widgets Overview of terms Data: a set of facts (items) D, usually stored in a database Pattern: an expression E in a language L, that describes a subset of facts Attribute: a field in an item i in D. Interestingness: a function ID,L that maps an expression E in L into a measure space M Overview of terms The Data Mining Task: For a given dataset D, language of facts L, interestingness function ID,L and threshold c, find the expression E such that ID,L(E) c efficiently. Examples of Large Datasets Government: IRS, … Large corporations WALMART: 20M transactions per day MOBIL: 100 TB geological databases ATT 300 M calls per day Scientific NASA, EOS project: 50 GB per hour Environmental datasets Examples of Data mining Applications 1. Fraud detection: credit cards, phone cards 2. Marketing: customer t