Lecture 18Introduction to Multiprocessors.ppt

Lecture 18:Introduction to Multiprocessors Prepared and presented by: Kurt Keutzer with thanks for materials from Kunle Olukotun, Stanford; David Patterson, UC Berkeley Why Multiprocessors? Needs Relentless demand for higher performance Servers Networks Commercial desire for product differentiation Opportunities Silicon capability Ubiquitous computers Exploiting (Program) Parallelism Exploiting (Program) Parallelism -2 Need for Parallel Computing Diminishing returns from ILP Limited ILP in programs ILP increasingly expensive to exploit Peak performance increases linearly with more processors Amhdahl’s law applies Adding processors is inexpensive But most people add memory also What to do with a billion transistors ? Technology changes the cost and performance of computer elements in a non-uniform manner logic and arithmetic is becoming plentiful and cheap wires are becoming slow and scarce This changes the tradeoffs between alternative architectures superscalar doesn’t scale well global control and data So what will the architectures of the future be? Elements of a multiprocessing system General purpose/special purpose Granularity - capability of a basic module Topology - interconnection/communication geometry Nature of coupling - loose to tight Control-data mechanisms Task allocation and routing methodology Reconfigurable Computation Interconnect Programmer’s model/Language support/ models of computation Implementation - IC, Board, Multiboard, Networked Performance measures and objectives Use, Granularity General purpose attempting to improve general purpose computation (e.g. Spec benchmarks) by means of multiprocessing Special purpose attempting to improve a specific application or class of applications by means of multiprocessing Granularity - scope and capability of a processing element (PE) Nand gate ALU with registers Execution unit with local memory RISC R1000 processor Topology Topology - method of interconnection of processors Bus Full-crossb