大数据分析存储解决方案.pptxVIP

IBM存储解决方案 ——数据分析的存储;从企业数据向大数据的扩展;对新式基础架构的需求;大数据分析的新型架构解决方案;5;案例: 用大数据分析来加强 Smart Metering;IBM Big Data Analytics Reference Architecture;;InfoSphere BigInsights Hadoop-based 低延迟分析，针对多样化的、海量静态数据Data-At-Rest;What: 一种开源软件，将数据计算分布到整个集群的常见商用服务器和存储上 Why: 传统的计算架构是一种沿纵向扩展模式，通过更快的SAN、大容量内存和多级缓存将数据加载到CPU上，成本比较高。 What: Hadoop 把大数据集合拆分区划为小数据集合，再把小数据集合分发到多台普通服务器上，是一种横向扩展模式。 Why: Scalable, Flexible, Cost Effective, Fault Tolerent Components: Map Reduce, HDFS ;; Hadoop Stack;典型Hadoop存储的Pain Points;IBM Storage for Hadoop;数据加速 Experience the instant results that come from IBM FlashSystem Drive as much as 45X faster analytics results on certain workloads 数据负载的多样性和灵活性 XIV delivers predictable performance that scales linearly without hotspots delivering insights from analytics faster with tuning-free data distribution Scale-out, parallel processing of Elastic Storage software and integration with FlashSystem dramatically accelerates performance of Analytics clusters Virtual Storage Center with SVC automatically optimizes data warehouse performance and cost across Flash and Disk Mainframe Data Environments Integration with DB2 specialty analytics “engines” leveraging DS8870 delivers 4x reduction in batch times with new High Performance Flash Enclosures High speed encryption on every drive type secures data 数据保护和保留 LTFS EE w/ tape provides reduced TCO by up to 90% over disk for long term retention of data at rest with a large open format tape repository Reduce the amount of data to be stored by up to 25 times with ProtecTIER de-duplication ;Storage Infrastructure 需求;Midrange Entry Tier 0 Acceleration;IBM FlashSystem：为大数据分析应用设计的，让应用和数据实现极速;IBM XIV: Optimized data workload diversity for Big Data Analytics;;SAS 和 XIV 网格架构 —— 完美的结合;IBM SVC: Optimized data workload flexibility for Big Data Analytics;设计原则;25;;InfoSphere Streams: 大数据流分析;Current fact finding??前数据查询 分许流动中的数据——在数据落盘前 低延迟模式, push model 数据驱动——真正的数据分析 ;Real Time Analytics实时分析想象一下你如何用防火栓喝水;Adaptive Analytics自适