第7讲1大规模并行处理机系统 MPP.pptVIP

* * * * * * * * * * * * * * * * * * * 计算机机群CLUSTER OF COMPUTER A cluster is a type of parallel or distributed processing system, which consists of a collection of interconnected stand-alone computers working together as a single, integrated computing resource. a collection of workstations of PCs that are interconnected by a high-speed network work as an integrated collection of resources have a single system image spanning all its nodes 计算机机群系统结构Architecture of Cluster 高速互连网络HSN 机群中间层 SSI、可用性底层 OS NODE OS NODE OS NODE OS NODE OS NODE 串行应用 并行应用 并行编程环境PVM、MPI、Java Computer Cluster by Using Network 计算机机群连接方式1（无共享） D P/C M MIO NIC D P/C M MIO NIC LAN 计算机机群连接方式2（共享磁盘） D P/C M MIO NIC D P/C M MIO NIC 共享磁盘 19 连接方式（共享存储器） D P/C M MIO NIC D P/C M MIO NIC SCI 21 设计要点 可用性：充分利用冗余资源，使系统在尽可能时间内为用户服务； 单一系统映像SSI：通过组合各节点OS提供对系统资源的统一访问； Job Management PFS 需要高效通信系统 关于可用性中的检查点问题 CHECKPOINT(a,b,c) 可在内核、库、应用程序三级发生； a b d c x y z P Q R Process 一致性快照Checkpoint Consistency Snapshot（a--Consistency一致;b---No Consistency不一致） 如果进程之间不存在一个进程的检查点已接收了消息，而另一进程的检查点还未发送这个消息。称一致性快照。 a b x y z P Q R C ? If there is not the process which receives a message at checkpoint and another process has not sent the message at checkpoint, then we say that the related checkpoints are the Consistency Snapshot homework 1. What are the differences about MPP and SMP? Answer: MPP A large parallel processing system with a shared-nothing architecture Consist of several hundred nodes with a high-speed interconnection network/switch Each node consists of a main memory one or more processors Runs a separate copy of the OS SMP 2-64 processors today Shared-everything architecture All processors share all the global resources