Poster Type: Research Posters
Author: Md. Azahar Alam (The University of Toledo), Kishwar Ahmed (The University of Toledo)
Abstract: Detecting floating-point exceptions during Edge TPU inference is structurally hard: the accelerator has no floating-point unit, and attaching it fuses the mapped partition into one opaque operation whose values never leave the chip, so tensor inspection is impossible there. We instead read the host CPU's floating-point status register before and after each inference, which every floating-point operation in the pipeline sets because all of them execute on the host. Across five stock models, register polling detected 100% of exception-raising faults, tensor scanning 98.8%, and output inspection 24.6%. Polling adds under 1% to latency; the optional tensor scan costs 7% to 58%. Detection holds on the accelerator, where 90% to 99% of tensors become unobservable. The tool also counts int8 saturation, targeting the 72% of output-corrupting faults that raise no exception.
Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF