数据挖掘第三章概要1.pptVIP

数据挖掘：概念与技术 数据挖掘导论 Pang-ning Tan, Michael Stieinbach, and Vipin Kumar著 Pearson Education LTD. 范明 等译 人民邮电出版社 第3章 数据探索 鸢尾花数据集 汇总统计 可视化 *OLAP和多维数据分析 什么是数据探索 A preliminary exploration of the data to better understand its characteristics. Key motivations of data exploration include Helping to select the right tool for preprocessing or analysis Making use of humans’ abilities to recognize patterns People can recognize patterns not captured by data analysis tools  Related to the area of Exploratory Data Analysis (EDA) Created by statistician John Tukey Tukey’s other contributions: FFT, bit, software Seminal book is Exploratory Data Analysis by Tukey A nice online introduction can be found in Chapter 1 of the NIST Engineering Statistics Handbook /div898/handbook/index.htm 数据探索技术 In EDA, as originally defined by Tukey The focus was on visualization Clustering and anomaly detection were viewed as exploratory techniques In data mining, clustering and anomaly detection are major areas of interest, and not thought of as just exploratory In our discussion of data exploration, we focus on Summary statistics Visualization Online Analytical Processing (OLAP) 3.1 鸢尾花数据集 鸢尾花(Iris)数据集 Many of the exploratory data techniques are illustrated with the Iris Plant data set. Can be obtained from the UCI Machine Learning Repository /~mlearn/MLRepository.html From the statistician Douglas Fisher Three flower types (classes): Setosa Virginica Versicolour Four (non-class) attributes Sepal width and length Petal width and length 3.2 汇总统计 汇总统计 Summary statistics are numbers that summarize properties of the data Summarized properties include frequency, location and spread Examples: location - mean spread - standard deviation Most summary statistics can be calculated in a single pass through the data 频率和众数 频率和众数: 用于离散属性 频率(frequency ): 给定一个在{v1,..., vi,..., vk}上取值的分类属性x和m个对象的集合，值vi的频率定义为 For example, given the attribute ‘gender’ and a representati