Workshops Archive

Panel: "Is Explicit Communication Obsolete? Compilers, Runtimes and On What Matters Next"


Workshop: The 9th Annual Parallel Applications Workshop, Alternatives to MPI+X (PAW-ATM)

Authors: Jan Ciesko (Sandia National Laboratories), Dirk Van Essendelft (National Energy Technology Laboratory), John Shalf (Lawrence Berkeley National Laboratory), Szilárd Páll (KTH Center for Scientific Computing (KCSC)), Mathias Jacquelin (Cerebras), and Alex Aiken (Stanford University)

Abstract: As domain-specific accelerators gain importance and workloads increasingly exhibit structured, predictable communication patterns—particularly in machine learning, scientific computing, and tensor operations—the role of explicit communication primitives deserves renewed scrutiny. This panel examines whether the compiler and runtime stack should bear greater responsibility for inferring and optimizing communication, potentially relegating explicit APIs to legacy status.

The rise of Tile IRs and polyhedral compilation frameworks suggests a future where communication becomes an emergent property of program structure rather than a programmer directive. When tiling strategies, data dependencies, and memory hierarchies can be analyzed statically or just-in-time, do we still need developers to manually orchestrate point-to-point sends, broadcasts, and reductions? Or does the irregularity and dynamism of real applications—adaptive meshes, sparse data, load imbalance—ensure that explicit control remains essential?

This discussion will explore the tension between programmer productivity and performance portability, examining where today's compilation technology succeeds in hiding communication complexity and where it fails.

Panelists will debate whether the next decade belongs to smarter runtimes that auto-parallelize and auto-communicate, or whether the most demanding applications will always require the fine-grained control that only explicit communication provides.


Back to The 9th Annual Parallel Applications Workshop, Alternatives to MPI+X (PAW-ATM) Archive Listing

Back to Full Workshop Archive Listing