Packet Pushers

OCTOBER 25, 2024

Ethernet competes with InfiniBand as a network fabric for AI workloads such as model training. In other words, AI workloads do best with a lossless network. And while Ethernet has kept up with increasing demands to support greater bandwidth and throughput, it was. Read more »

Ethernet 83

Ethernet Infiniband Bandwidth Network 83

Rule 11

SEPTEMBER 20, 2024

Why is InfiniBand so popular for building AI networks? What about Ethernet for AI? Jeff Tantsura joins Tom Ammon and Russ White to discuss networks for AI workloads. Why is InfiniBand so popular for building AI networks? What about Ethernet for AI? link] download

Infiniband 92

Infiniband Ethernet Network Networking 92

Packet Pushers

MARCH 25, 2024

Take a Network Break! Nvidia announces new 800G switches, one for Ethernet and one for InfiniBand, for building AI fabrics. Nvidia also announces an “AI supercomputer,” a rack-scale pre-built bundle of Nvidia GPUs and CPUs connected via InfiniBand switches.

Infiniband 52

Infiniband Ethernet NaaS Network 52

Engineering at Meta

AUGUST 5, 2024

AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 Distributed training, in particular, imposes the most significant strain on data center networking infrastructure.

Network 132

Network Networking Topology Data Centers 132

Packet Pushers

AUGUST 21, 2024

On todays Network Automation Nerds, we get into the infrastructure required to support AI workloads. We also talk about InfiniBand and Ethernet as network fabrics for AI workloads, cabling considerations, and more. This is a sponsored episode. This is a sponsored episode.

Infiniband 52

Infiniband Ethernet Bandwidth Network 52

Engineering at Meta

MARCH 12, 2024

We are sharing details on the hardware, network, storage, design, performance, and software that help us extract high throughput and reliability for various AI workloads. Network At Meta, we handle hundreds of trillions of AI model executions per day. The other cluster features an NVIDIA Quantum2 InfiniBand fabric.

Infiniband 145

Infiniband Data Centers Server Network 145