ChubbyZookeeper原理与在分布式环境中的应用.pptxVIP

Chubby Zookeeper原理及在分布式环境中的应用 CodeBox-腾讯 Chubby Zookeeper 意义 Zookeeper 分布式 lexyacc 编译 谁在用? 能干什么? configuration leader election locking group membership lease management name service sharing bootstrap session management 特性 锁 粗粒度 分布式文件系统 小文件存取 通过paxos/zab算法保证最终一致性 临时结点 自动命名结点 事件通知 简单 易表达 高可用 松耦合 API丰富 易扩展 数据模型 系统集群结构 卒 将 卒 卒 卒 zookeeper读时序 follower follower follower leader client 1 2 follower zookeeper写时序 follower follower follower leader client 1 6 follower 3 2 4 5 写 123 456 3 4 5 这几步是类似经典的2PC chubby读时序 follower follower follower leader client 1 2 chubby写逻辑 follower follower follower leader client 2 3 这步就是paxos算法的第二步，是引入leader lease 之后对paxo算法的优化。 1 2 2 2 3 3 3 4 两个漂亮的思路 反向通知的实现 通过传统的一问一答，实现反向通知 读性能平行扩展 引用观察者角色 美 Chubby在bigtable的应用 保证bigtable集群只有一个master 保存bigtable启动时所需要的数据 监控tablet server及其死活 保存Bitable的schema info 保存ACL 其它应用 名字服务 配置管理 用户权限控制 序列号分配 分布式消息队列 启动引导 chubby vs zookeeper 高性能 vs 数据一致性 Paxos vs Zab Client Cache vs No Cache UDP vs TCP paxos算法 (phase 1) A proposer selects a proposal id n and sends prepare request with id n to ½ acceptors If an acceptor receives a prepare request with id n greater than any prepare request it has responded, then it responds with a promise not to accept any more proposals with id less then n and with the highest id proposal value that it has accepted paxos算法 (phase 2) If the proposer receives ½ prepare response, it sends an accept request to each of those acceptors for a proposal with id n and value v, where v is the value of the highest id proposal among the responses, or is any value if the responses reported no proposals If an acceptor receives an accept request for a proposal with id n, it accepts the proposal unless it has already responded to a prepare request with id greater then n Paxos算法演示 A B X Y Z 提案者 民主 投票者 势力、炫耀 No.1 NO.1 NO.1 Value1 Value1 Value1 NO.1 Value1 Paxos算法演示 A B X Y Z No.1 NO.1 NO.1 No.0 No.1 No.1 NO.0 提案者 民主 投票者 势力、炫耀 Paxos算法演示 A B X Y Z No.1 NO.1 NO.1 No.2 NO.0 NO.2 NO.2 NO.2 Value2 Value2 Valu