Balancing System Resource Supply and Demand （平衡系统的资源供给和需求）.pdf

Balancing System Resource Supply and Demand for Effective Computing Xiaodong Zhang Ohio State University Computing is Pervasive and Powerful Computing resources become cheap and prolific. Increasingly low cost for fast CPUs and large memory. Cluster and Internet connect computing nodes easily. Three types of major computing resources: High end systems, e.g. Blue Gene/L, Earth Simulator. Ultra high performance but expensive. (customer designed nodes/networks) Cluster systems, e.g. ICT’s Downing (and many other Top-500’s) Low cost, but low sustained performance. (commodity nodes/networks) Google has been a successfully scalable example. Global systems, e.g., TeraGrid. Microsoft/IBM “cloud computing” Utilizing global computing resources, but high Internet cost and overhead. Clients are pervasive in everywhere in the globe Desktops, laptops, PDAs, etc. directly connect to the Internet or via wireless Major Resources in Computing and Network Systems Good News in supply CPU cycles: oversupplied for many applications. Memory bandwidth: improved dramatically. Memory capacity: increasingly large and low cost. I/O bandwidth: improved dramatically. Disk capacity: huge and cheap. Cluster and Internet bandwidths: very rich. Bad News in demand CPU cycles per Watt decreases. (less energy efficient). Cache capacity: always limited. Improvement of data access latencies significantly lags behind. Adam Smith: the balance is guided by an “invisible hand” in the market. We need to balance Oversupplied cycles High demand of fast data accesses and low energy cost Foot Steps of Challenges in HPC Foot Steps of Challenges in HPC “”