Workshops Archive

Optimizing system memory bandwidth with micron CXL memory expansion modules on intel Xeon 6 processors


Workshop: 7th Workshop on Heterogeneity and Memory Systems (HMEM)

Authors: Anil Godbole (Intel Corporation) and Rohit Sehgal, Vinicius Petrucci, and Vishal Tanna (Micron)

Abstract: High-Performance Computing (HPC) and Artificial Intelligence (AI) workloads typically demand substantial memory bandwidth and, to a degree, memory capacity. CXL memory expansion modules, also known as CXL "type-3" devices, enable enhancements in both memory capacity and bandwidth for server systems by utilizing the CXL protocol which runs over the PCIe interfaces of the processor. This paper discusses experimental findings on achieving increased memory bandwidth for HPC and AI workloads using Micron's CXL modules. Memory expansion via CXL boosts read-only bandwidth by 24% and mixed read/write bandwidth by up to 39%. Across HPC and AI workloads, the geometric mean of performance speedups is 24%.


Back to 7th Workshop on Heterogeneity and Memory Systems (HMEM) Archive Listing

Back to Full Workshop Archive Listing