武汉理工大学现代计算机体系结构英文Lecture4 Memory Data Prefetching.pdfVIP

高级计算机体系结构设计及其在数据中心和云计算的应 用 Lecture 4 Memory Data PrefetchingMemory Data Prefetching 高级计算机体系结构设计及其在数据中心和云计算的应 用 Prefetching (1/3) • Fetch block ahead of demand • Target compulsory, capacity, ( coherence) misses – Why not conflict? •• Big challenges:Big challenges: – Knowing “what” to fetch • Fetching useless blocks wastes resources – Knowing “when” to fetch • Too early  clutters storage (or gets thrown out before use) • Fetching too late  defeats purpose of “pre”-fetching 高级计算机体系结构设计及其在数据中心和云计算的应 用 Prefetching (2/3) • Without prefetching: L1 L2 DRAM Load Data Total Load-to-Use Latency • With prefetching: timetime • With prefetching: Prefetch Load Data Much improved Load-to-Use Latency • Or: Prefetch Load Data Somewhat improved Latency Prefetching must be accurate and timely 高级计算机体系结构设计及其在数据中心和云计算的应 用 Prefetching (3/3) • Without prefetching: Run • With prefetching: Load timetime Prefetching removes loads from critical path 高级计算机体系结构设计及其在数据中心和云计算的应 用 Common “Types” of Prefetching • Software • Next-Line, Adjacent-Line • Next-N-Line • Stream Buffers • Stride • “Locali