SNS网站mixi.jp的技术架构说明文档.docVIP

SNS网站mixi.jp的技术架构说明文档 mixi.jp scaling out with open source Batara Kesuma mixi, Inc. bkesuma@mixi.co.jp  Introduction .Batara Kesuma .CTO of mixi, Inc.  What is mixi? .Social networking service . Diary, community, message, review, photo album, etc. . Invitation only .Largest and fastest growing SNS in Japan  Latest information -Friends new diary -Comments history -Communities topics - Friends new reviews Friends -Friends new albums My latest diaries and reviews Community listing User Testimonials  History of mixi .Development started in December 2003 . Only 1 engineer (me) . 4 months of coding .Opened on February 2004  Two months later .10,000 users .600,000 PV/day  The “Oh crap!” factor .This model works .But how do we scale out?  The first year .The online population of mixi grew significantly .600 users to 210,000 users  The second year .210,000 users to 2 million users  And now?  More than 3.7 million users 15,000 new users/day Population of Japan is: 127 million Internet users: 86.7 million Source CIA Factbook  70% of active users (last login less than 72 hours)  Average user spends 3 hours 20 minutes on mixi per week  Ranked 35th on Alexa worldwide, and 3rd in Japan  PV growth in 2 years Google Japan mixi Amazon Japan  Users growth in 2 years 3,500,000 0 875,000 1,750,000 2,625,000 Users 04/03 05/03 06/03  Our technology solutions  The technology behind .Linux 2.6 .Apache 2.0 .MySQL .Perl 5.8 .memcached .Squid  diary cluster message cluster other cluster HOT OBJECTSmemcached Powered by diary cluster message cluster other cluster HOT OBJECTSmemcached Powered by mod_proxy images REQUEST REQUEST mod_perl  MySQL .More than 100 MySQL servers .Add more than 10 servers/month .Non-persistent connection .Mostly InnoDB .Heavily rely on the use of DB partitioning (our own solution)  DB replication .MySQL server load gets heavy .Add more slaves mod_perl DBR