Rule 11

SEPTEMBER 20, 2024

What are the requirements for running AI workloads over a data center fabric? Why is InfiniBand so popular for building AI networks? Jeff Tantsura joins Tom Ammon and Russ White to discuss networks for AI workloads. link] download What are the requirements for running AI workloads over a data center fabric?

Infiniband 92

Infiniband Ethernet Network Networking 92

Engineering at Meta

JUNE 12, 2024

Supporting GenAI at scale has meant rethinking how our software, hardware, and network infrastructure come together. Optimal connectivity between GPUs: Large-scale model training involves transferring vast amounts of data between GPUs in a synchronized fashion. requires revisiting trade-offs made for other types of workloads.

Infiniband 141

Infiniband Data Centers Topology Network 141

Engineering at Meta

AUGUST 5, 2024

AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 Distributed training, in particular, imposes the most significant strain on data center networking infrastructure.

Network 132

Network Networking Topology Data Centers 132

Engineering at Meta

MARCH 12, 2024

We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads. Today, we’re sharing details on two versions of our 24,576-GPU data center scale cluster at Meta. We use this cluster design for Llama 3 training.

Infiniband 145

Infiniband Data Centers Server Network 145

Router-switch

SEPTEMBER 25, 2024

In today’s high-speed networking world, optimizing and troubleshooting performance is crucial, especially with high-performance equipment like NVIDIA Infiniband switches. Whether you’re a data center admin or network engineer, mastering effective techniques is key.

Infiniband 40

Infiniband Network Networking Routers 40