Workshop: 21st Workshop on Workflows in Support of Large-Scale Science (WORKS26)
Authors: Md Saiful Islam and Douglas Thain (University of Notre Dame)
Abstract: Moving a workflow developed at one HPC site to another rarely succeeds without trial and error. Package managers, containers, and workflow specifications such as backpacks all describe what a workflow needs, but none describes how a given site must be used, so even a portable workflow requires manual adjustment at each site. That missing half includes the site's resource shape, storage, network permissions, and operating policies, scattered across the batch system, prose documentation, and undocumented behavior. We propose the HPC site profile, a structured, evidence-backed description whose every field traces to the measurement, documentation, or pilot job that established it. A bounded language-model agent extracts documented fields with citations, each verified deterministically or discarded, while login measurements and pilot jobs supply the rest. The profile then preflights a workflow into an execution plan or an early, explainable failure. We build and evaluate profiles at three production sites.
Back to 21st Workshop on Workflows in Support of Large-Scale Science (WORKS26) Archive Listing
Back to Full Workshop Archive Listing