面向高维数据的子空间聚类算法研究-计算机软件与理论专业毕业论文.docxVIP

The The Research on Subspace Clustering for High Dimensional Data Abstraet Clustering is an important task of data mining．Nowadays clustering large-scaled and high dimensionaI datasets is a hard and hot issue．Because of data sparsity． eruptY space phenomenon and the curse of dimensionality．it is common for all of the Objects in a dataset tO be nearly equidistant from each other，completely masking the clusters．As the number of dimensions in a dataset increases，distance measures become increasingly meaningless．So traditional clustering methods based on distance similarity can’t perform well．In order to solve these problems，in this thesis we have done some work as follows： Firstly．because traditional clustering algorithms encounter many difficuries and challenges when dealing with the high dimensional data，we compare the advantages and shortcomings of different dimensional reduction methods．and then conclude that subspace clustering methods are essential and useful． After further discussing existing subspace clustering algorithms，we find that they can’t work as efficiently as we imagine．The reason lies in that traditional subspace clustering algorithms must scan database many times to discover the subspace of clusters．Moreover,these methods can deal with only single data type． numerical or categorical data．Sinee we notice the great similarity between subspace and frequent pattern of association rule analysis，this thesis proposes a subspace clustering method based on pattern tree(PSC Algorithm for short)．PSC can discover the subspace by scanning the database once．So PSC can improve the emciency of clustering．Besides．the method can handle both numerical data and categorical data．Experiments demonstrate that our method significantly improves on the accuracy and speed of previous methods． Most clustering models define similarity among different objects by distances over dimensions．However，distance functions are not always adequate in capturing correlations among the objec