Workshops Archive

Beyond FLOPS and Kernels: Benchmarking Agentic Science and the Future Role of Python


Workshop: High Performance Python for Science at Scale

Authors: Pete Mendygral (HPE), Sunita Chandrasekaran (University of Delaware), Michela Taufer (University of Tennessee, Knoxville); Glenn Lockwood (VAST Data); Rollin Thomas (Lawrence Berkeley National Laboratory); and Minjia Zhang (University of Illinois at Urbana-Champaign)

Abstract: Python has become the dominant language for scientific computing, AI, and high-performance computing workflows. As supercomputing enters an era increasingly shaped by foundation models, autonomous agents, and AI-guided scientific discovery, the community faces a fundamental question: what should we benchmark next?

This panel brings together leaders from HPC, AI, and scientific software to discuss how benchmarks can continue to influence system architecture in the age of agentic workflows. Should future benchmarks measure isolated kernels and application performance, or end-to-end scientific outcomes? How do we evaluate systems that combine simulation, machine learning, retrieval, reasoning, and autonomous decision-making? And what role should Python play as the orchestration layer for increasingly heterogeneous and distributed computing environments? Panelists will explore whether Python can serve as the foundation for next-generation benchmarks and how benchmark design can guide the architecture of future AI-enabled supercomputers.


Back to High Performance Python for Science at Scale Archive Listing

Back to Full Workshop Archive Listing