PredictorDirected Stream Buffers UCSB Computer Science预测定向流缓冲区大学计算机科学.pptVIP

Sherwood, Sair, and Calder Predictor-Directed Stream Buffers Timothy Sherwood Suleyman Sair Brad Calder Overview Introduction Past Stream Buffer work Predictor-Directed Stream Buffers Policy Improvements Results Contribution Introduction Memory Wall Latency reduction through prefetching without eating too much bandwidth Stream Buffers are one of the most used simple to implement very efficient Pointer based codes Past Stream Buffer work Jouppi 1990 consecutive cache line FIFO Palacharla and Kessler 1994 non-unit stride (based on memory chunk) allocation filters Farkas et. al. 1997 PC-based stride fully associative / non-overlapping Past Stream Buffer work Past Stream Buffer work Past work targeted at streaming in arrays either in sequential order or stride order (multidimensional array) Could not handle Pointer Codes repetitive non-striding references Need a more General Predictor Predictor-Directed Stream Buffer The Goal: Simple and efficient hardware based prefetching of complex but predictable streams Approach: Take a general predictor and hook it up to the well established stream buffer front end. Separate the predictor from the prefetcher Can use almost any predictor 2 Delta Context Markov PSB Generalized Architecture PSB Stages Allocation Prediction Probe Prefetching Lookup Stage Descriptions Allocation Stream Buffer is allocated to a particular load the buffer is initialized subject to Allocation Filters Prediction an empty buffer entry asks for an address subject to limited predictor speed. Stage Descriptions (Continued) Probe if there are free ports remove useless prefetches not mandatory Prefetching subject to scheduling for ports and priority, prefetches are sent to memory Lookup when a load performs an L1 access, the Stream Buffers are checked in parallel PSB Implementation Tried many different address predictors Best is Stride Filtered Markov similar to Joseph and Grunwald’s Predictor first order Markov striding behavior is filtered out Difference