Poster Type: ACM SRC Posters
Author: Dragana Grbic (Rice University)
Abstract: Exascale supercomputers Frontier and Aurora provide infrastructure for executing applications across thousands of compute nodes, with massive MPI tasks, intensive CPU multi-threading, and heavy computation offloaded to GPUs. These heterogeneous workloads pose significant challenges for performance measurement and analysis tools. We refined the hpcanalysis framework as a multi-layered infrastructure consisting of a C++ ingestion engine for high-throughput, selective access to performance measurement slices, a query interface for extracting slices via specialized queries, and a Python API for high-level analytical tasks. This provides a scalable, efficient, interactive interface that ingests measurements for an execution across 100K MPI ranks on Aurora in under 10 seconds. We also designed HpcDataFrame, a GPU-accelerated substitute for the Pandas library, offloading heavy computations to NVIDIA, AMD, and Intel GPUs, achieving speedups of up to 314x over Pandas processing. Collectively, our contributions provide a scalable substrate for performance diagnostics at the absolute limit of modern supercomputing.
Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF