Technical Papers Archive

Bridging Precision and Performance Gaps: Scientific Computing on AI-Oriented Architectures


Authors: Weicheng Xue, Kai Yang, Yongxiang Liu, Baisong Xu, Dengdong Fan, Xianglin Liu, Yonghong Tian, and Pengxiang Xu (Pengcheng Laboratory)

Abstract: The rapid rise of AI-oriented accelerators has reshaped compute systems around low-precision tensor engines, raising a practical question for the HPC community: Under what conditions can such hardware support scientific workloads that demand numerical robustness, irregular memory access, and scalability? Using the Ascend 910 NPU series as a representative tensor-centric platform, we characterize precision, execution, and memory-hierarchy bottlenecks that hinder the direct deployment of scientific codes. From this characterization, we develop and evaluate workload-specific mappings that combine heterogeneous execution, mixed-precision numerical formulations, hierarchical memory orchestration, and communication–computation overlap. Evaluations spanning kernels, numerical solvers, quantum simulation, and Monte Carlo applications show that AI-native NPUs can achieve numerical robustness, competitive performance, and satisfactory scalability when these constraints are addressed in a coordinated manner. Our results provide a state-of-the-practice case study of how scientific workloads can be adapted to tensor-centric architectures, while distinguishing transferable optimization principles from Ascend-specific implementation details.


Presentation: file

Back to Technical Papers Archive Listing