Poster Type: Research Posters
Author: Ahmedur Rahman Shovon (Argonne National Laboratory), Romain Pereira (Argonne National Laboratory), Xingfu Wu (Argonne National Laboratory), Brice Videau (Argonne National Laboratory), Swann Perarnau (Argonne National Laboratory)
Abstract: Next-generation X-ray science (XRS) detectors are driving continuous, multi-stage streaming pipelines with facility-scale data rates approaching petabytes per second. These workflows require real-time reconstruction, AI inference, and feedback-driven control under strict performance and energy constraints, yet current software stacks often require manual tuning of batching, transport, and resource decisions.
We propose Drava, an event-driven runtime for scientific streaming pipelines. Developers express application stages as reusable components, while Drava manages scheduling, batching, data movement, and execution across heterogeneous resources. Integrated with ptychography and tomography applications, Drava sustains high-rate streaming at about 31 kHz. Compared with PvaPy, it handles unpaced input without dropping frames and achieves up to 2.36× higher throughput. Batching improves throughput by up to 2.44×, while agentic Bayesian optimization identifies a configuration 2.24× faster than the best manual configuration. Drava also exposes throughput-energy trade-offs for performance- and energy-aware scientific workflows.
Best Poster Finalist (BP): yes
Poster: PDF
Poster Summary: PDF