数据挖掘-CHAPTER1-引言案例分析.ppt

* * * * * This chapter will not be in the new version, will it? BUT SHOULD WESTILL INTRODCE THEM SO THAT THEY WILL GET AN OVERALL PICTURE? * * * * * * * * * * * 数据挖掘功能(2) 分类和预测 找出描述和识别类或概念的模型( 函数), 用于标号未知的对象的标号预测/Predict some unknown class labels 例如根据气候对国家分类, 或根据单位里程的耗油量对汽车分类 模型表示: 判定树(decision-tree), 分类规则, 神经网络 判别分析discriminat analysis 有监督方法 supervised method/在已知对象分成若干类别并取得各种类别的一组观测样本，在此基础上根据某些准则（学习）建立判别式；然后对未知类别样本进行（判别）分类 预测: 预测某些未知或遗漏的数值值/定量的quantitative输出变量 * 数据挖掘功能(3) 聚类分析Unsupervised learning (i.e., Class label is unknown) 类标号(Class label) 未知: 对数据分组, 形成新的类. 例如, 对房屋分类, 找出分布模式 聚类原则: 最大化类内的相似性, 最小化类间的相似性 * 数据挖掘功能(4) 孤立点(Outlier)分析 孤立点: 一个数据对象, 它 与数据的一般行为不一致 孤立点可以被视为例外, 但对于欺骗检测和罕见事件分析, 它是相当有用的 趋势和演变分析 趋势和偏离: 回归分析 序列模式挖掘, 周期性分析 e.g., first buy digital camera, then buy large SD memory cards 基于相似的分析 Approximate and consecutive motifs * * 数据挖掘功能(5) -Structure and Network Analysis Graph mining Finding frequent subgraphs (e.g., chemical compounds), trees (XML), substructures (web fragments) Information network analysis Social networks: actors (objects, nodes) and relationships (edges) e.g., author networks in CS, terrorist networks Multiple heterogeneous networks A person could be multiple information networks: friends, family, classmates, … Links carry a lot of semantic information: Link mining Web mining Web is a big information network: from PageRank to Google Analysis of Web information networks Web community discovery, opinion mining, usage mining, … * Top-10 Most Popular DM Algorithms:18 Identified Candidates (I) Classification #1. C4.5: Quinlan, J. R. C4.5: Programs for Machine Learning. Morgan Kaufmann., 1993. #2. CART: L. Breiman, J. Friedman, R. Olshen, and C. Stone. Classification and Regression Trees. Wadsworth, 1984. #3. K Nearest Neighbours (kNN): Hastie, T. and Tibshirani, R. 1996. Discriminant Adaptive Nearest Neighbor Classification. TPAMI. 18(6) #4. Naive Bayes Hand, D.J., Yu, K., 2001. Idiots Bayes: Not So Stupid After All? Internat. Statist. Re