Poster Type: Research Posters
Author: Saho Orihara (Meiji University), Kouki Sakai (Meiji University), Reo Nagashima (Meiji University), Takaaki Miyajima (Meiji University)
Abstract: SpMV is a fundamental kernel in scientific computing, but irregular memory access limits its scalability on conventional parallel systems. The Cerebras CS-3 distributes all data across on-chip SRAM on a two-dimensional PE mesh, so accessing non-local data becomes inter-PE communication rather than a memory-hierarchy traversal. Whether this low-latency advantage is sustained at scale remains unclear.
We present the first execution-time breakdown of SpMV on the CS-3. Our novel contribution is identifying, under load balancing, which component dominates among computation, inter-PE communication, reduction, and synchronization wait. Load balancing achieved a 3.40x speedup for Poisson3Da, while inter-PE communication reached 71.2% of execution time for F1. We evaluate five matrices from the SuiteSparse collection.
At the poster session, we will walk visitors through our execution-time breakdown charts, explain the bottleneck transition using a simple broadcast-round model, and discuss implications for communication-aware SpMV on wafer-scale processors.
Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF