Workshop: 7th Workshop on Heterogeneity and Memory Systems (HMEM)
Authors: Alexandre Bardakoff (RIKEN Center for Computational Science (R-CCS)), Adrien Roussel (CEA), and Kento Sato (RIKEN Center for Computational Science (R-CCS))
Abstract: Managed memory promises one pointer that both the CPU and the GPU can dereference, with the system deciding where the pages live. We measured what that promise means on five systems: NVIDIA H100 NVL, GH200, GB10, and AMD MI300A and MI300X, running one benchmark identically on all of them: a page-granular pointer chase bracketed by device- and host-resident anchor buffers, cross-checked by an operating-system residency probe, and probing placement, lifecycle costs, memory pressure, memAdvise hints, and concurrency. The five systems follow four different placement rules. The same managed access costs 244ns on an empty H100 and 40152ns when GPU memory is full; the GH200 degrades eightfold under the same pressure, the GB10 not at all. Hints rescue the H100 by 40x, harm the GH200 by up to 44x and are inert on single-pool systems. A routine operating-system update rewrote the MI300X's placement rule on unchanged hardware and ROCm.
Back to 7th Workshop on Heterogeneity and Memory Systems (HMEM) Archive Listing
Back to Full Workshop Archive Listing