Rule 11

SEPTEMBER 20, 2024

Why is InfiniBand so popular for building AI networks? What about Ethernet for AI? Jeff Tantsura joins Tom Ammon and Russ White to discuss networks for AI workloads. link] download What are the requirements for running AI workloads over a data center fabric? What about Ethernet for AI?

Infiniband 92

Infiniband Ethernet Network Networking 92

Engineering at Meta

AUGUST 5, 2024

AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 The growing prevalence of AI has introduced a new era of communication demands.

Network 132

Network Networking Topology Data Centers 132

Packet Pushers

APRIL 5, 2024

To run AI workloads, a network needs thousands of GPUs and those GPUs must operate in sync. While there are advantages to using Ethernet for AI networking (including engineers well-trained in the protocol and a robust ecosystem), it wasnt designed.

Ethernet 52

Ethernet AI Networking Network Networking 52

How Funky

JULY 24, 2024

If you are actively looking to build out AI network infrastructure and want to utilize white box, cost effective switching, one of the challenges you have is what software you will use to design, deploy, operate and manage those network switches, because doing that by hand via a CLI will not be fun.

AI Networking 52

AI Networking Network Networking Network Switch 52

How Funky

AUGUST 1, 2023

Broadcom presented at Networking Field Day 32 on July 26, 2023 and they presented on their AI Networking solutions. These are products and architectures that address the needs of those building out AI data center focused networks. Obviously the design will work for regular data center workloads too.

AI Networking 52

AI Networking Network Networking Ethernet 52

Packet Pushers

JUNE 5, 2023

This week's Network Break discusses a new Google offering to interconnect public clouds, NVIDIA's platform for AI networking fabrics using Ethernet switches and DPUs, and Cisco's latest security acquisition.

AI Networking 52

AI Networking Ethernet Network Networking 52

Packet Pushers

JUNE 26, 2023

Cisco announces AI Networking versions of SIlicon One ASICs and buys another DEM business. HPE Greenlake adds AI LLM. Cisco announces AI Networking versions of SIlicon One ASICs and buys another DEM business. HPE Greenlake adds AI LLM. FTC talks bandwidth caps. We laughed. FTC talks bandwidth caps.

Bandwidth 52

Bandwidth AI Networking Network Networking 52