Research and ACM SRC Posters Archive

HV-Coll: Co-Designing Collective Communication with Vectorized Homomorphic Compression


Poster Type: ACM SRC Posters

Author: Jiefeng Zhou (University of South Florida)

Abstract: Inter-node collective communication constrains large-scale scientific simulations and distributed AI. Error-bounded lossy compression can reduce data volume, but prior CPU frameworks underuse memory bandwidth with scalar packing, lose compression ratio (CR) at SIMD-friendly block sizes, and repeat decompress–operate–compress (DOC) work during reductions. We present HV-Coll, which co-designs a block-aligned representation, SIMD encoding, outlier-aware fixed-length encoding, compressed-domain addition, and MPI collective schedules. Evaluated on 3,584 CPU cores, HV-Coll's homomorphic compression is up to 8.1x faster than hZCCL's scalar DOC workflow, and its outlier-aware encoding improves CR by up to 27.2%. HV-Coll collectives reach up to 47.2x, 23.4x, 43.8x, and 67.6x speedups over native MPI for Bcast, Scatter, Allreduce, and Alltoall, respectively.

Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing