Poster Type: ACM SRC Posters
Author: Urvij Saroliya (Technical University of Munich)
Abstract: Performance modeling enables runtime estimation, scalability analysis, and bottleneck identification without committing large-scale compute resources. However, existing methods rely on either analytical or empirical models: the former are interpretable and generalize by construction but are limited in accuracy by architectural assumptions, while the latter are accurate only where training data exists and offer no insight into performance-limiting factors. Addressing these concerns, we propose hardware-informed neural networks (HINN), applying the physics-informed neural network (PINN) methodology to multi-GPU performance modeling, where the governing "physics" consists of hardware-derived architectural laws. HINN retains established analytical models as differentiable priors and learns residual corrections subject to hardware-derived constraints enforced via automatic differentiation across the domain. Evaluated on five HPC applications on NVIDIA H100 GPUs, HINN achieves 7.6% and 9.9% median relative estimation error for kernel and communication predictions, while enabling extrapolation to unseen configurations and automated bottleneck classification.
Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF