Poster Type: Research Posters
Author: Max Engel (Friedrich Schiller University Jena), Alex Breuer (Friedrich Schiller University Jena)
Abstract: Tensor contractions are fundamental across computational science and machine learning, yet reaching high performance on domain-specific accelerators with large systolic arrays, such as AWS Trainium, remains challenging.
We present a compiler that optimizes a binary tensor contraction, given as an einsum equation with axis sizes, and lowers it into a Neuron Kernel Interface (NKI) kernel. The core contribution of the poster is the automatic search: the contraction is lowered to an intermediate representation, and candidate kernel and SBUF tilings are ranked by a measurement-based model of Trainium2's engines. The compiler is evaluated on Trainium2, where the generated kernels reach 155 of 157 TFLOPS on square matrix multiplication and run 2.3 to 2.9 times faster than torch.einsum on four contractions from the TCCG benchmark.
In the poster session we walk visitors through the pipeline, from einsum equation to emitted NKI code, and discuss the tiling decisions behind the results.
Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF