MARK-apachezookeepertechtuesday-100824184718-phpapp02英文资料.pdf

Apache ZooKeeper Why use it? What to expect in the future? Andrei Savu @TechTuesday Outline Why use it? Crash Course Practical Example What to expect in the future (3.4.0 release)? GSoC 2010 New Contrib Work in Progress Crash Course What is ZooKeeper? A highly available, scalable, distributed, configuration, consensus, group membership, leader election, naming and coordination service. What is ZooKeeper? (2) replicated in memory tree data structure somehow similar to a file system no partial read / writes no renames ordered updates strong persistence guarantees conditional updates (version) watches for data changes ephemeral nodes generated file names ZooKeeper Data Model hierarchical namespace each znode has data and children data is read and written in its entirety Basic ZooKeeper API string create(path, data, acl, flags) delete(path, expected_version) stat set_data(path, data, expected_version) (data, stat) get_data(path, watch) stat exists(path, watch) string[] get_children(path, watch) ZooKeeper Service Facts: 1) all servers store a copy of the data in memory 2) the leader is elected at startup 3) followers respond to clients 4) all updates go through the leader 5) responses are sent when a majority of servers have persisted the change Practical Example Distributed Queue (Python) /blog/2009/05/building-a- distributed-concurrent-queue-with-apache-zookeeper/ /henryr/pyzk-recipes Retry operation on ConnectionLoss: /andreisavu/pyzk-recipes GSoC 2010 3 projects / 5 months 1. Monitoring & Web-based interface Status: Committed to the trunk 1. JIRA: ZOOKEEPER-701 2. Progress Tracking Wiki 3. Monitoring for Ganglia, Nagios and Cac