Authors: Sameeran Joshi (University of Utah); Oscar Antepara, Samuel Williams, and Hans Johansen (Lawrence Berkeley National Laboratory (LBNL)); and Mary Hall (University of Utah)
Abstract: This paper describes the mapping of geometric multigrid (GMG) onto the Cerebras Wafer Scale Engine (WSE-3). The WSE wafer integrates almost a million cores along with a low-latency 2D mesh network, providing unprecedented on-chip bandwidth and fine-grained communication. Although the architecture is predominantly used for deep learning, we explore the suitability of WSE for accelerating GMG. GMG solves sparse linear systems efficiently by recursively coarsening the grid, which leads to more rapid convergence with less computation. As compared to prior implementations of stencils on WSE, this demonstration highlights the challenges of mapping a layered algorithm – and the full set of operators – onto a dataflow architecture. We compare the performance of this implementation to that of the HPGMG benchmark on an NVIDIA GH200 GPU. Across different GMG configurations and problem sizes, we observe a speedup of up to 25× as compared to a single GH200 node.
Presentation: file