Workshop: 7th Workshop on Heterogeneity and Memory Systems (HMEM)
Authors: Jaskin Kabir (North Carolina State University, University of North Carolina at Charlotte) and Ron Sass (University of North Carolina at Charlotte)
Abstract: Distributed-memory, many-core accelerators are often bottlenecked by the task of transferring data to and from the local memories. Existing solutions place much of the orchestration burden onto the host processor. Instead, we propose an ELF-aware DMA engine that parses an ELF file from host memory and uses off-the-shelf DMA and interconnect IP to transfer data with minimal host intervention. We also extend the ELF format to encode both high-fan-out load and many-to-one gather operations in one file. On our FPGA proxy modeled after a kilocore accelerator, our design is 4.8× faster than host memcpy and 39% faster than scatter-gather DMA on load, with host preprocessing reduced to two register writes. Extrapolation to the kilocore scale suggests the engine costs roughly 1.6% of PE capacity. For many-core distributed-memory accelerators, we conclude that this approach is a viable middle ground between the host manually transferring bytes and a custom NoC/DMA stack.
Back to 7th Workshop on Heterogeneity and Memory Systems (HMEM) Archive Listing
Back to Full Workshop Archive Listing