Ceph Tiering高性能架构.pdf

Ceph Tiering with High performance architecture Speaker : Thor Chin Chief Architect Agenda Introduction to Ceph Ceph Tiering Architecture Performance Measurement Tools Performance Testing Result Conclusion Introduction to Ceph Why we need Ceph? Distributed storage system - Fault tolerant , no SPoF X86 Commodity hardware - Saving you costs, giving you flexibility Large scale – Incremental expansion - 10s to 1000s of nodes Unified storage platform - Scalable object , Block , File system. Open source – No vender lock-in Automatically balance the file system Data security - with 2 or more copies in different physical store media. Ceph Architecture PG and Pools PG number for Single OSD : 30 ~ 300 (soft limit), usually we suggest 256 Average distribute PGs on OSD will get better performance PG number for each Pool = Number of OSD * PG number of 1 OSD / Replica Example for this Pool : 4 * 256 / 2 = 512 Object Size = 4KB ~ 32MB, default = 4MB Sometimes, with the increasing of the Object size, throughput will also be increased CRUSH Maps CRUSH Map Parameters 1. Settings : Basic settings, usually we don’t need to change 2. Devices : Physical device list (List all osd devices and define the id and name mapping) 3. Types : Define bucket types (from Root to OSD) 4. Buckets : Define OSD group and tiering structure 5. Rules : crush rule (define object