SheepdogYetAnotherAll-In-OneStorageForOpenstack.pptVIP

Openstack Hong Kong Summit Liu Yuan 2013.11.8 Who I Am Active contributor to various open source projects such as Sheepdog, QEMU, Linux Kernel, Xen, Openstack, etc. Primary top contributor of Sheepdog project and co-maintains it with Kazutaka Morita from NTT Japan since 2011.1 Technically lead the storage projects based on Sheepdog for internal uses of Contacts Email: namei.unix@ Micro Blog: @淘泰来 Introduction Why Sheepdog Minimal assumptions of underlying kernel and file system Any type of file systems that support extended attribute(xattr) Only require kernel version = 2.6.32 Full of features snapshot, clone, incremental backup, cluster-wide snapshot, discard, etc. User-defined replication/erasure code scheme on VDI(Virtual Disk Image) basis Auto node/disk management Easy to set up the cluster with thousands of nodes Single daemon can manage unlimited number of disks in one node as efficient as RAID0 as many as 6k+ for a single cluster Small Fast and very small memory footprint (less than 50 MB even when busy) Easy to hack and maintain, 35K lines of code in C as of now Exploration Sheepdog Volume Copy-On-Write Snapshot Disk-only snapshot, disk memory snapshot Live snapshot, offline snapshot Rollback(tree structure), clone Incremental backup Instant operation, only create 4M inode object Push many logics into client - simple and fast code ! Only 4 opcodes for store, read/write/create/remove, snapshot is done by QEMU block driver or dog Requests serialization is not handled by Sheepdog but client Inode object is treated the same as data object Openstack Openstack Storage Components Cinder - Block Storage Support since day 1 Glance - Image Storage Support merged at Havana version Nova - Ephemeral Storage Not yet started Swift - Object Storage Swift API compatible In progress Final Goal - Unified Storage Copy-On-Write anywhere ? Data dedup ? Roadmap Look Into The Future RESTful Container Plans to be Openstack Swift API compatible first, coming soon Hyper