Birds of a Feather Archive

The Status and Future of Unified Shared Memory in the CPU+GPU Ecosystem


Authors: Igor Sfiligoi (San Diego Supercomputing Center (SDSC)), Amit Ruhela (Texas Advanced Computing Center (TACC)), Austin Ellis (Advanced Micro Devices (AMD)), Flavio Galeazzo (HLRS), Reuben Budiarja (Oak Ridge National Laboratory (ORNL)), Todd Evans (NVIDIA Corporation)

Abstract: Originally GPU and CPU memory spaces were completely separate, with explicit data movements needed for interaction between CPU and GPU compute cores. Over time, all major GPU vendors have added hardware and software capabilities for transparent access to each other’s memory, with various levels of granularity and integration, with unified shared memory (USM) representing the most tight integration. This BoF will start by outlining the history, current state, and planned future of cross-memory technologies. We will then open the floor for discussion with conference attendees to gather their perspectives on where this technology should evolve going forward.

Long Description: This proposed BoF is focused on the topic of GPU-accelerated systems that support transparent sharing of the memory space between the CPU and GPU compute cores, also known as Unified Shared Memory (USM). The BoF has the double objectives of informing the research community of the current state and near-future direction of such systems, and collecting feedback from that community about the soundness of the existing roadmaps. The BoF is organized by representatives of four major HPC centers and two major hardware vendors, all of them having experience with USM-based systems, allowing them to provide a comprehensive overview of both hardware roadmaps, infrastructure software developments, scientific software applications and direct feedback from major HPC user communities. Those same entities are also involved in planning the design of future systems, and are thus very interested in understanding the needs of the research community they are serving. The BoF format thus greatly fits the needs of both the organizers and the research community, which is a core audience of the SC conference.

The BoF is organized in roughly two parts:

In part 1, the experts will each give a presentation on the topic, focusing on their area of expertise. The vendor representatives will focus primarily on their hardware capabilities, the related software ecosystem and roadmaps, while the HPC representatives will focus on the user experience and perceived needs of the served user base. The later will also share the porting and optimization experiences by the developers of applications that made use of the Unified Shared Memory (USM).

Part 2 will use the remaining time for an open-floor discussion with the audience. We hope for a very engaging discussion with the research community, but will also moderate such a discussion to allow for a variety of opinions to be expressed. While we do plan to answer the questions to the best of our abilities, we will also keep record of all the feedback and will summarize it for an actionable outcome. We would be particularly interested in hearing from researchers who have existing experience with USM and can elaborate its benefits, lack thereof, and/or its downsides. Barriers to accessing USM systems and considerations regarding non-USM systems would also be of great interest.

An example of a successful porting of a real world application that will be discussed is the widely used computational fluid dynamics (CFD) code OpenFoam. One of the aspects we want to emphasize is that for many applications used in engineering, research and development, portability and productivity are very important. That said, the BoF presentations will not limit themselves to only the success stories, and drawbacks of USM vs using a more traditional, partitioned memory approach will also be explored.

To the best of our knowledge, this is the first time such a BoF has been organized at a major research conference. We believe such an event is thus overdue for this important subject.


Back to Birds of a Feather Archive Listing