云计算模型在铁路大规模数据处理中的应用.pdfVIP

34 5 Vol . 34 No . 5 20 10 10 J OU RNAL OF BEIJ ING JIA OT ON G U N IV ERSIT Y Oct . 2010 : 1座机电话号码 2010 0座机电话号码 刘 真, 刘 峰, 张宝鹏, 马 飞, 高石玉 , 100044 : 对铁路行业的计算资源数据处理进行了特征分析. 讨了云计算模型中的虚拟化技术在 铁路计算资源整合及M ap Reduce 编程模型在大规模数据处理中的应用模式. 采用Hadoop 开源平 台和Intel 的虚拟化管理平台T ash , 提出和实现了基于云计算技术的铁路数据处理框架模型, 并通 过大规模的货票数据处理实例验证了框架模型的可扩展性和高效性. : 云计算; 虚拟化; M ap Reduce; 大规模数据处理 : T P 399: U 29413 : A Research on Cloud Computing and Its Application in Railway L I U Zhen, L I U Feng , ZH A N G Baop eng , M A Fei , GA O S hiy u Eng neer ng Research Center of H ghSpeed Ra lw ay N etw ork M anagement of M n stry of Educat on , Be j ng J aotong U n vers ty , Be j ng 100044, Ch na Abstract :T h s paper analyzes t he charact er st cs of t he comput ng resources and data process ng n Ch na ra lway. V rtual zat on s ut l zed f or ra lw ay resource nt egrat on and MapReduce programm ng model s ut l zed for ra lw ay larg escale dat a process ng. Found ng on H adoop and a v rtual zat on m an agement platform T ash , t h s paper proposes and mplements a ra lw ay data process ng f ramework. A fre ght nvo ce dat a process ng appl cat on has ver f ed t he scalab l t y and t he h gh eff c ent may be seen n our eff ort . Key words: cloud comput ng; v rt ual zat on ; M ap Reduce; largescale dat a process ng v ce Comput ng , . . , , , [ 2] . , , , 3 , , . , , , . 3 . , : [ 2] Cloud . [ 1] , Comput ng , Gr d Comput ng U t l t y Comput ng Ser . : 20 100427 : 863 2006A A0 1Z 207 ; 2009JBZ 0071 ; Int el - K 09L00030 : 1977 , , , , . email : zhl u@ bjt u. edu. cn. 5 : 15 , . . 2 : , , [ 35] , ; MapReduce , . , 21 . , 1 . [ 6] , . , , . . , 11 . , , M , , , m i 1, , n , m m i j , i i j . m i . . , , , , . 1 . , 5 , , . 1 . 12 , , , CPU : , 1 . , , 12 , 4 KB . , , 45 . , 1 . , 160 GB, 1 T B. 4~ 6 . , , , , . , , . 2 . 1 , , F g. 1 Impr oved resource ut l zat on rate based on v rtual zat on