Mathias Verraes

JANUARY 8, 2025

Then, well examine three organisational models that are specific to software development: the Spotify Model, the Agile Fluency Model, and Team Topologies. Team Topologies Image: Henny Portman Team Topologies is a software organisational model that focuses on fast flow and value creation.

Topology 162

Topology Network Networking Energy 162

Engineering at Meta

AUGUST 5, 2024

Topology We built a dedicated backend network specifically for distributed training. To support large language models (LLMs), we expanded the backend network towards the DC-scale, e.g., incorporating topology-awareness into the training job scheduler. We designed a two-stage Clos topology for AI racks, known as an AI Zone.

Network 132

Network Networking Topology Data Centers 132

Engineering at Meta

JUNE 12, 2024

Meta runs different types of backend networks, topologies, and training jobs that have tight dependencies between software and hardware components. Instead, we ensure components are compatible with each other and roll component upgrades up in a sliding fashion. This transition has not been without its challenges.

Fashion 138

Fashion Data Centers Artificial Intelligence Server 138

Engineering at Meta

JUNE 12, 2024

Optimal connectivity between GPUs: Large-scale model training involves transferring vast amounts of data between GPUs in a synchronized fashion. We implemented collective communication patterns with network topology awareness so that they can be less latency-sensitive.

Infiniband 141

Infiniband Data Centers Topology Network 141

Engineering at Meta

MARCH 12, 2024

This solution enables thousands of GPUs to save and load checkpoints in a synchronized fashion (a challenge for any storage solution) while also providing a flexible and high-throughput exabyte scale storage required for data loading.

Infiniband 145

Infiniband Data Centers Server Network 145

Confluent

MAY 9, 2019

The control plane becomes essential when outages have occurred and a large-scale system must get back online in a coordinated fashion, perhaps with incremental, restricted functionality. In the context of a payment system, you might need to drain the current set of payments for a topology change. AccountProcessor.java.

Application 94

Application Topology DevOps Fashion 94

Kentik

MAY 15, 2017

In a similar fashion, Facebook recently published a blog describing their Express Backbone that provides internal connectivity between datacenters. The system then dynamically provisions an MPLS LSP topology to meet the observed loads while optimizing for various traffic classes (e.g. latency sensitive vs. insensitive).

Network 40

Network Networking Fashion Topology 40