大数据典型相关分析的云模型方法杨静.pdfVIP

34 10 Vol.34 No. 10 2013 10 Journal on Communications October 2013 doi:10.3969/j.issn.1000-436x.2013.10.015 150001 CCA, canonical correlation analysisPB CCA CCA TP391 B 1000-436X(2013)10-0121-14 Canonical correlation analysis of big data based on cloud model YANG Jing, LI Wen-ping, ZHANG Jian-pei (College of Computer Science and Technology, Harbin Engineering University, Harbin 150001, China) Abstract: The complexity of traditional CCA methods is too high to meet the requirements to analyze big data due to their huge scale which is reaching the level of peta-byte. A novel approach to CCA was proposed to mine the big data by introducing the cloud model which is a brand-nowel theory about the uncertainty artificial intelligence. A distributed ar- chitecture based on cloud computing was established. All of the clouds distributing on the nodes of the distributed archi- tecture were combined to a center cloud via cloud operation (where cloud is a synopsis of data and which is a concept coming from the cloud theory). A type of virtual sample of data called cloud drops created based on the center cloud. Fi- nally the computing of CCA was imposed on the cloud drops. The CCA was impose on the cloud drops with less volume, which improves the efficiency. Experimental results on real data sets indicate the effectiveness of this method. Key words: big data; canonical correlation analysis (CCA); cloud model; cloud operation; cloud computing CCA, canonical correla- 1 tion analysis 2008