Workshop: The 9th Annual Parallel Applications Workshop, Alternatives to MPI+X (PAW-ATM)
Authors: Julian Samaroo (MIT)
Abstract: MPI has long been the default substrate for distributed scientific computing, but it is not the only path to scalable performance—and in Julia, it is often not the most productive one. This talk surveys the landscape of MPI-free distributed computing in Julia, centered on the standard-library Distributed package and its surprisingly performant primitives for remote execution, data movement, and cluster management. I will review which widely-used Julia packages already run on top of Distributed, and how their capabilities compare to their MPI-based counterparts.
The core of the talk focuses on Dagger.jl, a task-based parallel runtime that provides unified support for both Distributed and MPI: every algorithm expressed in Dagger runs unchanged across either backend, as well as across multi-CPU and multi-GPU configurations. I will highlight Dagger's Datadeps API, which lets users express data dependencies declaratively and have the scheduler automatically handle communication, synchronization, and placement—whether the underlying transport is Distributed or MPI. Through concrete examples, I will show how this abstraction delivers portability without sacrificing performance, and close with an overview of the current state of distributed computing across the broader Julia package ecosystem.
Back to The 9th Annual Parallel Applications Workshop, Alternatives to MPI+X (PAW-ATM) Archive Listing
Back to Full Workshop Archive Listing