Demystifying GPU Micro Architecture through Micro Benchmarking英文电子书.pdfVIP

Demystifying GPU Microarchitecture through Microbenchmarking Henry Wong, Misel-Myrto Papadopoulou, Maryam Sadooghi-Alvandi, and Andreas Moshovos Department of Electrical and Computer Engineering, University of Toronto henry, myrto, alvandim, moshovos@eecg.utoronto.ca Abstract—Graphics processors (GPU) offer the promise of more than an order of magnitude speedup over conventional processors for certain non-graphics computations. Because the GPU is often presented as a C-like abstraction (e.g., Nvidia’s CUDA), little is known about the characteristics of the GPU’s architecture beyond what the manufacturer has documented. This work develops a microbechmark suite and measures the CUDA-visible architectural characteristics of the Nvidia GT200 (GTX280) GPU. Various undisclosed characteristics of the pro- cessing elements and the memory hierarchies are measured. This analysis exposes undocumented features that impact program performance and correctness. These measurements can be useful Fig. 1: Streaming Multiprocessor Fig. 2: Thread Processing Cluster for improving performance optimization, analysis, and modeling with 8 Scalar Processors Each with 3 SMs Each on this architecture and offer additional insight on the decisions made in developing this GPU. I. INTRODUCTION The graphics processor (GPU) as a non-graphics compute processor has a different architecture from traditional sequential processors. For developers and GPU architecture and compiler researchers, it is essential to understand the architecture of a