Research and ACM SRC Posters Archive

Load Balancing and Communication Bottlenecks in SpMV on the Cerebras WSE-3


Poster Type: Research Posters

Author: Saho Orihara (Meiji University), Kouki Sakai (Meiji University), Reo Nagashima (Meiji University), Takaaki Miyajima (Meiji University)

Abstract: SpMV is a fundamental kernel in scientific computing, but irregular memory access limits its scalability on conventional parallel systems. The Cerebras CS-3 distributes all data across on-chip SRAM on a two-dimensional PE mesh, so accessing non-local data becomes inter-PE communication rather than a memory-hierarchy traversal. Whether this low-latency advantage is sustained at scale remains unclear.

We present the first execution-time breakdown of SpMV on the CS-3. Our novel contribution is identifying, under load balancing, which component dominates among computation, inter-PE communication, reduction, and synchronization wait. Load balancing achieved a 3.40x speedup for Poisson3Da, while inter-PE communication reached 71.2% of execution time for F1. We evaluate five matrices from the SuiteSparse collection.

At the poster session, we will walk visitors through our execution-time breakdown charts, explain the bottleneck transition using a simple broadcast-round model, and discuss implications for communication-aware SpMV on wafer-scale processors.

Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing