SuperNIC is a new class of network accelerators designed to supercharge hyperscale AI workloads in Ethernet-based clouds. It provides lightning-fast network connectivity for GPU-to-GPU communication, achieving speeds reaching 400Gb/s using remote direct memory access (RDMA) over converged Ethernet (RoCE) technology.
SuperNICs combine the following unique attributes:
High-speed packet reordering to ensure that data packets are received and processed in the same order they were originally transmitted. This maintains the sequential integrity of the data flow.
Advanced congestion control using real-time telemetry data and network-aware algorithms to manage and prevent congestion in AI networks.
Programmable compute on the input/output (I/O) path to enable customization and extensibility of network infrastructure in AI cloud data centers.
Power-efficient, low-profile design to efficiently accommodate AI workloads within constrained power budgets.
Full-stack AI optimization, including compute, networking, storage, system software, communication libraries and application frameworks.
NVIDIA recently unveiled the world’s first SuperNIC tailored for AI computing, based on the BlueField-3 networking platform. It’s a part of the NVIDIA Spectrum-X platform, where it integrates seamlessly with the Spectrum-4 Ethernet switch system.
Together, the NVIDIA BlueField-3 SuperNIC and Spectrum-4 switch system form the foundation of an accelerated computing fabric specifically designed to optimize AI workloads. Spectrum-X consistently delivers high network efficiency levels, outperforming traditional Ethernet environments.
“In a world where AI is driving the next wave of technological innovation, the BlueField-3 SuperNIC is a vital cog in the machinery,” said Yael Shenhav, vice president of DPU and NIC products at NVIDIA. “SuperNICs ensure that your AI workloads are executed with efficiency and speed, making them foundational components for enabling the future of AI computing.”
more information is available at https://blogs.nvidia.com/blog/what-is-a-supernic/