数据挖掘-8-聚类分析.pptVIP

数据挖掘理论与应用 哈尔滨工业大学 管理学院 叶强 yeqiang@hit.edu.cn 8 聚类分析( Cluster Analysis) 聚类（Cluster） 将数据对象分组成为多个类或簇(Cluster)，同类对象间具有较高的相似性，不同类的对象间具有较大的差异性。 Cluster: a collection of data objects Similar to one another within the same cluster Dissimilar to the objects in other clusters Cluster analysis Grouping a set of data objects into clusters Clustering is unsupervised classification: no predefined classes Typical applications As a stand-alone tool to get insight into data distribution As a preprocessing step for other algorithms What Is Good Clustering? A good clustering method will produce high quality clusters with high intra-class similarity low inter-class similarity The quality of a clustering result depends on both the similarity measure used by the method and its implementation。 The quality of a clustering method is also measured by its ability to discover some or all of the hidden patterns. Data Structures Data matrix 数据矩阵 Dissimilarity matrix 相异性矩阵 Dissimilarity in Clustering Dissimilarity/Similarity metric: Similarity is expressed in terms of a distance function, which is typically metric: d(i, j) The definitions of distance functions are usually very different for interval-scaled, boolean, categorical, ordinal and ratio variables. Type of data in clustering analysis Interval-scaled variables: Binary variables: Nominal, ordinal, and ratio variables: Variables of mixed types: Interval-valued variables Standardize data Calculate the mean absolute deviation: where Calculate the standardized measurement Similarity and Dissimilarity Between Objects Distances are normally used to measure the similarity or dissimilarity between two data objects Some popular ones include: Minkowski distance: where i = (xi1, xi2, …, xip) and j = (xj1, xj2, …, xjp) are two p-dimensional data objects, and q is a positive integer If q = 1, d is Manhattan distance Similarity and Dissimilarity Between Objects (Cont.) If q = 2, d is Euclidean distance: Properties d(i,j) ? 0 d(i,i) =