Workshop: The 9th Annual Parallel Applications Workshop, Alternatives to MPI+X (PAW-ATM)
Authors: Christopher Maynard (Met Office UK)
Abstract: Weather and climate models are large and complex collections of mathematical modelling software. They can take more than a decade to develop and can be in use for a quarter of century or more. They also typically undergo constant revisions and improvements from teams of developers. The proliferation of programming models in the MPI+X paradigm is therefore particularly problematic as cost of developing and maintaining multiple X implementations for different architectures in such a code base becomes prohibitive. The rapid evolution of the programming models has exacerbated the problem. Fortran has been the de facto standard programming language for weather and climate applications and can considered a low-level domain specific language for numerical computation. The ability to write code that in some sense looks likes the maths is part of its appeal and enables developers to be productive. The invasive level of parallel code additions required for performance degrades the sustainability of the code base.
One approach to solving these problems has been to raise the level of abstraction from a general-purpose language to a domain specific language (DSL). Here domain specific information is encoded in and exploited by the programming model for optimisation purposes. Key to this approach is a strong separation of concerns between the science/maths code and the parallel and optimisation code. This approach enables developers to write code which looks like maths whilst allowing the portability and performance by having different routes to optimised codes for different architectures. This comes with the cost of designing and maintaining the DSL.
The Met Office is part of the Momentum partnership and is developing the Momentum modelling software system. The atmosphere model, LFRic, is developed and co-designed in a its own DSL, embedded in Fortran. Part of the DSL is the python domain specific compiler, PSyclone. The advantages and limitations of the this approach are discussed, including the consequences of design choices such as embedding the DSL in Fortran. Some performance results from LFRic are presented as evidence to support the arguments. Finally, how emerging agentic programming techniques may complement DSL-based approaches and what this implies for future weather and climate software development is considered.
Back to The 9th Annual Parallel Applications Workshop, Alternatives to MPI+X (PAW-ATM) Archive Listing
Back to Full Workshop Archive Listing