Engineering at Meta

AUGUST 5, 2024

Topology We built a dedicated backend network specifically for distributed training. To support large language models (LLMs), we expanded the backend network towards the DC-scale, e.g., incorporating topology-awareness into the training job scheduler. We designed a two-stage Clos topology for AI racks, known as an AI Zone.

Network 132

Network Networking Topology Data Centers 132

Engineering at Meta

JUNE 12, 2024

Optimal connectivity between GPUs: Large-scale model training involves transferring vast amounts of data between GPUs in a synchronized fashion. Solving this problem requires a robust and high-speed network infrastructure as well as efficient data transfer protocols and algorithms. Both of these options had tradeoffs.

Infiniband 141

Infiniband Data Centers Topology Network 141

Confluent

FEBRUARY 13, 2019

Streams represent the core data model, and stream processors are the connecting nodes that enable flow creation resulting in a streaming data topology. The streaming topology shows a flow of data through an organization, representing the real-time DNA of your business. In some cases, it is desirable to hide these protocol concerns.

Application 92

Application Protocol Topology Fashion 92

Confluent

MAY 9, 2019

The control plane becomes essential when outages have occurred and a large-scale system must get back online in a coordinated fashion, perhaps with incremental, restricted functionality. In the context of a payment system, you might need to drain the current set of payments for a topology change. AccountProcessor.java.

Application 94

Application Topology DevOps Fashion 94