Packet Pushers

OCTOBER 25, 2024

Ethernet competes with InfiniBand as a network fabric for AI workloads such as model training. In other words, AI workloads do best with a lossless network. And while Ethernet has kept up with increasing demands to support greater bandwidth and throughput, it was. Read more »

Ethernet 83

Ethernet Infiniband Bandwidth Network 83

Engineering at Meta

AUGUST 5, 2024

AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 Distributed training, in particular, imposes the most significant strain on data center networking infrastructure.

Network 132

Network Networking Topology Data Centers 132

Engineering at Meta

JUNE 12, 2024

Supporting GenAI at scale has meant rethinking how our software, hardware, and network infrastructure come together. Solving this problem requires a robust and high-speed network infrastructure as well as efficient data transfer protocols and algorithms. requires revisiting trade-offs made for other types of workloads.

Infiniband 141

Infiniband Data Centers Topology Network 141

Packet Pushers

AUGUST 21, 2024

On todays Network Automation Nerds, we get into the infrastructure required to support AI workloads. We discuss key considerations including bandwidth, the substantial power and cooling requirements of AI infrastructure, and GPUs. This is a sponsored episode. This is a sponsored episode.

Infiniband 52

Infiniband Ethernet Bandwidth Network 52

Engineering at Meta

MARCH 12, 2024

We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads. Network At Meta, we handle hundreds of trillions of AI model executions per day. The other cluster features an NVIDIA Quantum2 InfiniBand fabric.

Infiniband 145

Infiniband Data Centers Server Network 145

Router-switch

SEPTEMBER 25, 2024

In today’s high-speed networking world, optimizing and troubleshooting performance is crucial, especially with high-performance equipment like NVIDIA Infiniband switches. Whether you’re a data center admin or network engineer, mastering effective techniques is key.

Infiniband 40

Infiniband Network Networking Routers 40