Research and ACM SRC Posters Archive

Skyway My Way! InfiniBand to Ethernet Optimization and Benchmarking


Poster Type: Research Posters

Author: Joe Downs (Los Alamos National Laboratory (LANL)), Brian Hsu (Los Alamos National Laboratory (LANL)), Jeremy Mao (Los Alamos National Laboratory (LANL)), Jesse Martinez (Los Alamos National Laboratory (LANL)), Doug Egan (Los Alamos National Laboratory (LANL))

Abstract: Modern high performance computing and AI/ML workloads increasingly require efficient bridges between InfiniBand compute fabrics and Ethernet storage systems to enable large data transfer capabilities. The NVIDIA Skyway is a gateway device designed to translate IPoIB (Internet Protocol over InfiniBand) for external Ethernet services. This work seeks to evaluate and optimize the Skyway by benchmarking bandwidth performance, validating multi-tenant partition security boundaries, and identifying optimal deployment strategies for HPC workloads. Testing is performed on a nine-node cluster with an InfiniBand, Ethernet, and Skyway switch. A modified version of GPCNeT is used to measure cluster bandwidth under congestion. NFS performance is benchmarked within both the Ethernet network and across the Skyway. Finally, the network is partitioned to separate traffic of two controller nodes, emulating a secure user compute system. Our experimentation paves the way for Skyway implementation on production clusters, providing insight on hashing and storage I/O improvements for future work.

Best Poster Finalist (BP): no
Poster: PDF
Poster Summary: PDF


Back to Poster Archive Listing