Rule 11

SEPTEMBER 20, 2024

What are the requirements for running AI workloads over a data center fabric? Why is InfiniBand so popular for building AI networks? What about Ethernet for AI? link] download What are the requirements for running AI workloads over a data center fabric? Why is InfiniBand so popular for building AI networks?

Infiniband 92

Infiniband Ethernet Network Networking 92

Engineering at Meta

AUGUST 5, 2024

Our paper, “ RDMA over Ethernet for Distributed AI Training at Meta Scale ,” provides the details on how we design, implement, and operate one of the world’s largest AI networks at scale. Distributed training, in particular, imposes the most significant strain on data center networking infrastructure.

Network 132

Network Networking Topology Data Centers 132

Engineering at Meta

MARCH 12, 2024

Today, we’re sharing details on two versions of our 24,576-GPU data center scale cluster at Meta. Custom designing much of our own hardware, software, and network fabrics allows us to optimize the end-to-end experience for our AI researchers while ensuring our data centers operate efficiently.

Infiniband 145

Infiniband Data Centers Server Network 145