武汉理工大学现代计算机体系结构英文Lecture12 Shared Memory Multiprocessor.pdfVIP

高级计算机体系结构设计及其在数据中心和云计算的应用 Lecture 12 SharedShared--Memory MultiMemory Multi--ProcessorsProcessors 高级计算机体系结构设计及其在数据中心和云计算的应用 Shared-Memory Multiprocessors • Multiple threads use shared memory (address space) – “SysV Shared Memory” or “Threads” in software • Communication implicit via loads and stores – Opposite of explicit message-passing multiprocessors •• Theoretical foundation: Theoretical foundation: PRAM modelPRAM model P P P P 1 2 3 4 Memory System 高级计算机体系结构设计及其在数据中心和云计算的应用 Why Shared Memory? • Pluses – App sees multitasking uniprocessor – OS needs only evolutionary extensions – Communication happens without OS • MinusesMinuses – Synchronization is complex – Communication is implicit (hard to optimize) – Hard to implement (in hardware) • Result – SMPs and CMPs are most successful machines to date – First with multi-billion-dollar markets 高级计算机体系结构设计及其在数据中心和云计算的应用 Paired vs. Separate Processor/Memory? • Separate CPU/memory • Paired CPU/memory – Uniform memory access – Non-uniform memory access (UMA) (NUMA) • Equal latency to memory • Faster local memory –– Low peak performanceLow peak performance •• Data placement mattersData placement matters – High peak performance CPU($) CPU($) CPU($) CPU($) CPU($) CPU($) CPU($) CPU($) Mem R Mem R Mem R Mem R Mem Mem Mem Mem 高级计算机体系结构设计及其在数据中心和云计算的应用 Shared vs. Point-to-Point Networks • Shared network • Point-to-point network: – Example: bus