Research and ACM SRC Posters Archive

GNNs Beyond HBM: Compressed, Bit-Exact Feature Streaming for Out-of-Core Training


Poster Type: Research Posters

Author: Rajni Parshuram Pawar (Illinois Institute of Technology, Gnosis Research Center), Luke Logan (Illinois Institute of Technology), Xian-He Sun (Illinois Institute of Technology), Antonios Kougkas (Illinois Institute of Technology)

Abstract: Graph neural networks increasingly train on node-feature matrices that exceed GPU high-bandwidth memory: ogbn-papers100M's is ~57 GB, beyond a commodity 8-40 GB card. Out-of-core systems (GIDS, Ginex, MariusGNN, GraphBolt, HMGraph) already stream features from host memory past HBM, but always uncompressed. GnnPress compresses the streamed feature store: it exposes an ordinary float array to the GNN while storing features compressed and materializing only a small, double-buffered resident window. On an NVIDIA A100-40GB, GnnPress trains ogbn-papers100M (52.9 GiB), which out-of-memories an in-core layout. A lossless zstd codec is bit-identical to the in-core run every epoch (max|dloss|=|dacc|=0), including under mini-batch SGD; a GPU-native lossy codec, cuSZp, reaches 3.13x while perturbing training loss by at most 1e-6 over 30 epochs. Mini-batch SGD reaches 61% accuracy at a measured 1.7 GiB peak GPU (31x below in-core). Compressing the feature stream, not merely avoiding OOM, distinguishes GnnPress from prior uncompressed out-of-core GNN training.

Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing