模糊聚类在特征取中的应用.docVIP

模糊聚类在特征选取中的应用 刘全金1,2, 赵志敏1, 李颖新3 （1. 南京航空航天大学理学院, 江苏 南京 210016；2. 安庆师范学院物理与电气工程学院，安徽 安庆 246011；3. 北京经纬纺机新技术有限公司机器视觉与智能研究所, 北京 100176） 摘 要：提出了一种基于模糊聚类算法的高维特征选取方法。首先，利用Bhattacharyya距离过滤样本类别无关的特征；然后，基于递归特征剔除过程，提出了基于模糊ISODATA聚类方法，以样本与聚类中心的加权距离作为可分性指标，产生候选特征子集；最后，以候选特征子集分类和聚类的AUC值和正确率作为目标函数，确定最佳特征子集。将该方法用于选取5个基因表达谱数据集的特征基因，结果显示该方法所选特征具有较好的分类和聚类能力，说明了提出的特征选取方法的有效性。 关键词：特征选取; 模糊ISODATA; 层次聚类; 支持向量机; K近邻 Application of Fuzzy Clustering Algorithm on feature selection Quanjin Liu1,2, Zhimin Zhao1 ,Ying-Xin Li3 （1. College of Science, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, China;2. Department of Physics, AnQing Normal College, Anqing, 246011, China; 3. Institute of Machine Vision and Machine Intelligence, Beijing Jingwei Textile Machinery New Technology Co., Ltd., Beijing 100176, China） Abstract: A new feature selection method based on clustering algorithm is proposed to selecting informative features. First, category-unrelated features are kicked out according to Bhattacharyya distance. Then, based on the process of recursive feature elimination, a weighted distance between sample and the cluster center generated by the fuzzy Interactive Self-Organizing Data Algorithm (ISODATA) is used as the index of feature for separating different classes. Finally, the candidate feature subset with the maximum AUC value and accuracy rate both in classification and clustering tests is selected as the optimal feature subset. The proposed feature subset selection method is applied to 5 gene expression profile datasets and experiment results show that the selected features have good performance in terms of both classification and clustering measurements. This demonstrates that the proposed method is effective for selecting informative features from high dimensional dataset. Key words: feature selection; fuzzy ISODATA; Hierachical clustering; Support vector machine; K- nearest neighbor 文献标识码: A 中图分类号: TP391, Q812 1 引言 从高维数据中选出与类别相关的特征是机器学习和模式分类的重要一步，特征选取方