大数据典型相关的分析云模型方法.pdfVIP

第34 卷第10 期 通 信 学 报 Vol.34 No. 10 20 13 年10 月 Journal on Communications October 2013 doi:10.3969/j.issn. 1000-436x.2013.10.015 大数据典型相关分析的云模型方法 杨静，李文平，张健沛 （哈尔滨工程大学 计算机科学与技术学院，黑龙江 哈尔滨 150001） 摘 要：针对传统大数据典型相关分析（CCA, canonical correlation analysis ）方法的高复杂度在面临大数据PB 级 数据规模时不再适应的现状，提出了一种基于云模型的大数据 CCA 方法。该方法在云计算架构的基础上，通过 云运算将各端点云合并为中心云，并据此产生中心云滴，以中心云滴作为大数据的不确定性复原小样本，在其上 施以CCA 运算，中心云滴的较小数据量提高了运算效率。在真实数据集上的实验结果验证了该方法的有效性。 关键词：大数据；典型相关分析；云模型；云运算；云计算 中图分类号：TP391 文献标识码：B 文章编号：1000-436X(2013)10-0121-14 Canonical correlation analysis of big data based on cloud model YANG Jing, LI Wen-ping, ZHANG Jian-pei (College of Computer Science and Technology, Harbin Engineering University, Harbin 150001, China) Abstract: The complexity of traditional CCA methods is too high to meet the requirements to analyze big data due to their huge scale which is reaching the level of peta-byte. A novel approach to CCA was proposed to mine the big data by introducing the cloud model which is a brand-nowel theory about the uncertainty artificial intelligence. A distributed ar- chitecture based on cloud computing was established. All of the clouds distributing on the nodes of the distributed archi- tecture were combined to a center cloud via cloud operation (where cloud is a synopsis of data and which is a concept coming from the cloud theory). A type of virtual sample of data called cloud drops created based on the center cloud. Fi- nally the computing of CCA was imposed on the cloud drops. The CCA was impose on the cloud drops with less