Technical Papers Archive

TOPIQ: Statistical Error Propagation for Quantity-of-Interest Prediction Under Lossy Compression


Authors: Youyuan Liu, Bo Jiang, and Taolue Yang (Temple University); Sheng Di and Robert Underwood (Argonne National Laboratory); and Sian Jin (Temple University)

Abstract: Lossy compression is essential for managing massive scientific data, but per-element error bounds do not translate into bounds on downstream quantities of interest (QoIs) such as regional averages, neural network predictions, or multi-field derived quantities. We present TOPIQ, a statistical error-propagation framework that predicts QoI-level bias and uncertainty from compact compression metadata (less than 0.1% of original data). TOPIQ decomposes QoIs into primitive operators with closed-form propagation rules accounting for spatial error correlation and data-error coupling; new QoIs are supported by composition at runtime with no per-QoI derivation or retraining. Across 552 evaluations spanning four datasets, three compressors, four QoI families, and eight error bounds, 93.1% of configurations achieve well-calibrated predictions. Pre-computed metadata enables post-hoc uncertainty quantification for arbitrary query regions at 56x-402x speedup over direct computation. A case study demonstrates integration into an AI-driven analysis pipeline with end-to-end confidence intervals for dynamically composed queries.


Presentation: file

Back to Technical Papers Archive Listing