article thumbnail

NB471: Nvidia Unveils 800G Ethernet, InfiniBand Switches For AI Fabrics; ‘Ghost Jobs’ Haunt Job Boards

Packet Pushers

Nvidia announces new 800G switches, one for Ethernet and one for InfiniBand, for building AI fabrics. Nvidia also announces an “AI supercomputer,” a rack-scale pre-built bundle of Nvidia GPUs and CPUs connected via InfiniBand switches. Take a Network Break!

article thumbnail

Hedge 244: Networks for AI

Rule 11

Why is InfiniBand so popular for building AI networks? Why is InfiniBand so popular for building AI networks? What are the requirements for running AI workloads over a data center fabric? What about Ethernet for AI? Jeff Tantsura joins Tom Ammon and Russ White to discuss networks for AI workloads. What about Ethernet for AI?

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

How Meta trains large language models at scale

Engineering at Meta

There are two leading choices in the industry that fit these requirements: RoCE and InfiniBand fabrics. On the other hand, Meta had built research clusters with InfiniBand as large as 16K GPUs. So we decided to build both: two 24k clusters , one with RoCE and another with InfiniBand. Both of these options had tradeoffs.

article thumbnail

HN755: Optimizing Ethernet to Meet AI Infrastructure Demands

Packet Pushers

Ethernet competes with InfiniBand as a network fabric for AI workloads such as model training. Read more » Ethernet competes with InfiniBand as a network fabric for AI workloads such as model training. Read more » Ethernet competes with InfiniBand as a network fabric for AI workloads such as model training.

article thumbnail

NAN071: Understanding the Infrastructure Requirements for AI Workloads (Sponsored)

Packet Pushers

We also talk about InfiniBand and Ethernet as network fabrics for AI workloads, cabling considerations, and more. We also talk about InfiniBand and Ethernet as network fabrics for AI workloads, cabling considerations, and more. On todays Network Automation Nerds, we get into the infrastructure required to support AI workloads.

article thumbnail

Network Break 359: Arista Increases Its 400G Switch Portfolio; Nvidia Accelerates InfiniBand

Packet Pushers

This week's Network Break examines new 400G switches from Arista, discusses the Wi-Fi Alliance's certification program for the HaLow long-range low-power standard, targets key Nvidia announcements, catches up on the latest in space networking, and more IT news.

article thumbnail

Top Tips for Debugging and Optimizing NVIDIA Networking Performance

Router-switch

In today’s high-speed networking world, optimizing and troubleshooting performance is crucial, especially with high-performance equipment like NVIDIA Infiniband switches. In this blog, we’ll share top tips for debugging and optimizing NVIDIA Infiniband networking performance.