《Mesos持久化存储初探-数人科技-周伟涛》.pdf

Introduction of Mesos persistent storage Weitao Zhou @ DataMan Content • How to run stateful service against current Mesos-0.22 • Disk isolation and monitoring • Persistent Volumes • Dynamic Reservations • What we can contribute for Mesos persistent storage How to run stateful service against current Mesos-0.22 • Making it outside of Mesos cluster • Storing data into local filesystem of the specified Mesos slave • Setting DFS to get rid of static reserve • Taking advantage of stateful service build-in data-replication feature Making it outside of Mesos Cluster • Scenarios ： • independent cluster: RabbitMQ cluster • constant resource usage, etc. • Pros: • mature solution • effortless • Cons: • decreasing resource usage Storing Data into Local Filesystem of the Specified Mesos Slave • Scenarios ： • Data disk is NOT included into Mesos resource • Avoid of data revoked by Mesos • The next task can restore data • Pros: • Using the CPU, RAM, network resource of the Mesos cluster: one single dockerized MySQL task • Cons: • Resource STATIC RESERVED to make sure the stateful service can be launched on the specified slave successfully always • Mesos can NOT release the outdated persisted data, have to manually do it • Data conflict: avoid it by launching one task per slave temporarily • how to share the data for HA? Setting DFS to get rid of static reserve • Pros: • HA • Get rid of static reserve • Cons: • network delay of data transfer. that can be accepted by MySQL/PG? • The network resource taken by data transfer is OUT of CONTROL: Setting another data transfer network to avoid it? = decreasing the network resource usage again Taking advantage of stateful service build-