introduction to distributed computing.pptVIP

? Copyright 2007 Aaron Kimball, Sierra Michels-Slettvet Lecture 1 – Introduction CSE 490h – Introduction to Distributed Computing, Spring 2007 Outline Administrivia Scope of Problems A Brief History Parallel vs. Distributed Computing Parallelization and Synchronization Problem Discussion Prelude to MapReduce Staff Aaron Kimball – Instructor ak@cs.washington.edu OH – Wed 2:30-3:30 Taj Campbell – TA tajc@cs.washington.edu OH – Fri 10:30-11:30 Sierra Michels-Slettvet – TA sierra@cs.washington.edu OH – Thurs 1:30-2:30 Adrian Caulfield – lab manager adrianmc@cs.washington.edu Goals and Expectations Weekly Lecture Weekly Reading Short response questions + discussion Weekly Lab (x4) Designed (mostly) to be done during the two hour lab. Final Project Proposal (Optional) Final Project Computer Speedup Scope of problems What can you do with 1 computer? What can you do with 100 computers? What can you do with an entire data center? Distributed problems Rendering multiple frames of high-quality animation Distributed problems Simulating several hundred or thousand characters Distributed problems Indexing the web (Google) Simulating an Internet-sized network for networking experiments (PlanetLab) Speeding up content delivery (Akamai) Parallel vs. Distributed Parallel computing can mean: Vector processing of data (SIMD) Multiple CPUs in a single computer (MIMD) Distributed computing is multiple CPUs across many computers (MIMD) A Brief History… 1975-85 Parallel computing was favored in the early years Primarily vector-based at first Gradually more thread-based parallelism was introduced A Brief History… 1985-95 “Massively parallel architectures” start rising in prominence Message Passing Interface (MPI) and other libraries developed Bandwidth was a big problem A Brief History… 1995-Today Cluster/grid architecture increasingly dominant Special node machines eschewed in favor of COTS technologies Web-wide cluster software Companies like Google take this to the extreme (10,0