Facebook中计算与存储分离的MapReduce框架.pptx

Facebook中计算与存储分离的MapReduce框架;;;;;;;Data Scientist and DW;Data Scientist and DW;Data Scientist and DW;;;;;;DW @FB: Hive on Hadoop (HDFS);Dynamic demand vs. static resource allocation;Efficiency at hyper scale;Elasticity Splitting DC for Storage and Compute;Elasticity Splitting DC for Storage and Compute;Elasticity Splitting DC for Storage and Compute;;;;Last ~25 years of HDD evolution;Last ~25 years of HDD evolution;Last ~25 years of Ethernet;Last ~25 years of HDD vs. Ethernet;When Ethernet is faster than HDDs And Data Center network is ‘flat’;;;;;;;HDFS IOPS/Node – very large cluster;HDFS (MB/