Birds of a Feather Archive

The Impact of GenAI on HPC Programming and Programming Models


Authors: Bradford Chamberlain (HPE), Rosa Badia (Barcelona Supercomputing Center (BSC), Universitat Politècnica de Catalunya (UPC)), Martin Schulz (Technical University of Munich), Christian Terboven (RWTH Aachen University), Michael Garland (NVIDIA Corporation), Chris Siefert (Sandia National Laboratories)

Abstract: According to many mainstream media outlets and tech gurus, the age of computer programmers is fading away as GenAI proves itself capable of helping with programming tasks, or completing them independently. And many of us probably have positive (and negative) stories about using AI in our day-to-day lives. But what do we expect the impact of GenAI to be on programming for HPC systems and applications?

This session kicks off with opening statements from thought leaders representing various HPC programming models (MPI, OpenMP, NVIDIA, Kokkos, COMPSs, and Chapel), followed by an open session for audience opinions, Q&A, and healthy debate.


Long Description: [Note: generative AI was not used in the creation of this submission]

The goal of this BoF is to create a forum for discussing the impact of Generative AI, LLMs, and connectionist systems on HPC programming and application development with a particular focus on HPC programming models. An overarching goal of the session will be to serve as a forum for expressing sentiments that are both pro-AI or AI-skeptical without fear of being dismissed for being overly optimistic or pessimistic. Specifically, we hope to create a space where participants will feel comfortable speaking their minds without the need to conform to a particular ideology or institutional party line.

To achieve a mix of curated material and free discussion, we have invited a number of thought leaders in the field of HPC programming models to kick off the session with opening statements expressing their views on the impact of AI on HPC programming. Motivating questions include: * How is the use of GenAI for HPC programming similar to its use in mainstream programming, and how is it different? * Do you anticipate that GenAI will notably change the role of the HPC programmer? How? * Can GenAI write large HPC applications? Will it be capable of this in the future? * Are the HPC programming models we have now a good match for GenAI programming? Does GenAI increase or reduce the need for alternative programming notations? * Are you optimistic or pessimistic about the impact of GenAI on HPC programming?

Each of these curated presentations will be hard-capped at ~2 slides and ~5 minutes, after which we will open the session up to audience participation. Audience members will be encouraged to ask questions of the opening speakers, or to present their own viewpoints if they have a unique insight that hasn’t been covered.

At the time of submission, we have invited the following people to participate in this BoF: Brad Chamberlain, Chapel (HPE) Christian Terboven, OpenMP (RWTH Aachen) Damien Lebrun-Grandie, Kokkos (ORNL) (pending) Martin Schulz, MPI (TUM), MPI Rosa Badia, COMPSs (BSC) TBD (NVIDIA), representing Legion, CUDA, and/or Legate We also have a list of ~3 other experts/technologies who we will tap if we have a 90-minute slot.

In the event of scheduling conflicts with any of the above speakers once the SC26 program is established, we’ll backfill them with participants of similar caliber and experience. We plan to gauge whether each participant is more on the optimistic or pessimistic side of the AI scale in order to avoid having the session be too one-sided.

The relevance of this BoF is that GenAI is obviously a massive topic at present, yet we are still early enough in its deployment and use—particularly for HPC programming—that the future remains unclear. Given the effort and investment required for writing HPC applications, it makes sense to take stock of where we are and where we’re going.

This is the first time we have proposed or organized this BoF, so it will be a fresh topic for SC26.


Back to Birds of a Feather Archive Listing