ebay网站架构.pdfVIP

Best Practices for Scaling Websites Lessons from eBay Randy Shoup eBay Distinguished Architect QCon Asia 2009 Challenges at Internet Scale • eBay manages … – 86.3 million active users worldwide – 120 million items for sale in 50,000 categories – Over 2 billion page views per day – eBay users trade over $2000 in goods every second -- $60 billion per year – eBay site stores over 2 PB of data – eBay processes 50 TB of new, incremental data per day – eBay Data Warehouse analyzes 50 PB per day • In a dynamic environment – 300+ features per quarter – We roll 100,000+ lines of code every two weeks • In 39 countries, in 8 languages, 24x7x365 48 Billion SQL executions/day! © 2009 eBay Inc. Architectural Forces at Internet Scale • Scalability – Resource usage should increase linearly (or better!) with load – Design for 10x growth in data, traffic, users, etc. • Availability – Resilience to failure (MTBF) – Rapid recoverability from failure (MTTR) – Graceful degradation • Latency – User experience latency – Data latency • Manageability – Simplicity – Maintainability – Diagnostics • Cost – Development effort and complexity – Operational cost (TCO) © 2009 eBay Inc. Best Practices for Scaling 1. Partition Everything 2. Asynchrony Everywhere 3. Automate Everything 4. Remember Everything Fails 5. Embrace Inconsistency © 2009 eBay Inc. Best Practice 1: Pa