automatic cpu-gpu communication strongmanagementstrong and optimization.pdfVIP

Automatic CPU-GPU Communication Management and Optimization Thomas B. Jablin Prakash Prabhu James A. Jablin Nick P. Johnson Stephen R. Beard David I. August Princeton University, Princeton, NJ Brown University, Providence, RI tjablin, pprabhu, npjohnso, sbeard, august@ jjablin@ Abstract memories. Unfortunately, not all communication management is The performance benefits of GPU parallelism can be enormous, efficient; cyclic communication patterns are frequently orders of but unlocking this performance potential is challenging. The ap- magnitude slower than acyclic patterns [15]. Transforming cyclic plicability and performance of GPU parallelizations is limited by communication patterns to acyclic patterns is called Optimizing ¨ the complexities of CPU-GPU communication. To address these Communication. Naıvely copying data to GPU memory, spawn- communications problems, this paper presents the first fully auto- ing a GPU function, and copying the results back to CPU memory matic system for managing and optimizing CPU-GPU communca- yields cyclic communication patterns. Copying data to the GPU tion. This system, called the CPU-GPU Communication Man- in the preheader, spawning many GPU functions, and copying the ager (CGCM), consists of a run-time library and a set of com