基于o的penstack docker打造spark大数据服务.pdf

SuperVessel: Enabling Spark as a Service with OpenStack and Docker SuperVessel Cloud •  Public cloud built on the POWER7/POWER8 servers with OpenStack •  It provides free access for students, researchers, developers across the world, and helps grow OpenPOWER ecosystem (used in 30+ universies now) •  It provides advanced technology services such as Spark as a Service, Docker Services, Cognive Compung Service, IoT Service, Accelerator as a Service (FPGA and GPU) 4/18/15 IBM Research - China 2 Spark as a Service Try it at: 3 steps to launch a Spark cluster, easy! Step 1: Login Step 2: Create Step 3: Ready! 4/18/15 IBM Research - China 3 Why OpenStack? •  Most popular IaaS soware •  Supports Docker* •  Heat can orchestra docker containers easily – good for provision a Spark cluster Picture source: hp:///?p=3801 4/18/15 IBM Research - China 4 Why Docker? •  Less resource consumpon than KVM –  We can provision more Spark clusters! •  Boot faster than KVM –  Users like fast provision! •  Incrementally build, revert and reuse your container –  We love Git and AUFS! •  However, Docker is not officially supported in OpenStack yet –  Nova Docker is an external component of OpenStack •  Port Docker to POWER Architecture (ppc64 and ppc64le) –  Ubuntu 15.04 includes Docker for Picture source: hp:///arcle/what-is-d