SPDK加速Ceph.pdf

Accelerate Ceph via SPDK XSKY’s BlueStore as a case study Haomai Wang, XSKY Ziye Yang, Intel Outline • Background • SPDK introduction • XSKY’s BlueStore • Conclusion Outline • Background • SPDK introduction • XSKY’s BlueStore • Conclusion Background • Low performance of Ceph’s storage service • Ceph’s architecture is designed on the low storage devices (with ms latency level) • There are more and more fast devices in both network and storage. • Network: 10G/25G/40G/100G (low performance - high performance) • Storage: HDD - SATA SSD - PCIe SSD - NVDIMM (high latency - low latency) • Challenge: Software design and implementation in Ceph is the bottleneck • Equipped with those fast devices, Software needs to be refreshed to explore the limitation of those hardware devices. Overview: ObjectStore and Data Model • ObjectStore • Object – “file” • Abstract interface for storing local • data (file-like byte stream) data • Attributes (small key/value) • EBOFS, FileStore • Omap (unbounded key/value) • EBOFS • Collection-”directory” • A user space extent-based object file • placement group shard(slice of the system RADOS pool) • Deprecated in favor of FileStore on • sharded by 32bit hash value BTRFS in 2009 • All writes are transactions • Atomic + Consistent + Durable • Isolation provided by OSD F