Engineering at Meta

AUGUST 5, 2024

Topology We built a dedicated backend network specifically for distributed training. To support large language models (LLMs), we expanded the backend network towards the DC-scale, e.g., incorporating topology-awareness into the training job scheduler. We designed a two-stage Clos topology for AI racks, known as an AI Zone.

Network 132

Network Networking Topology Data Centers 132

Engineering at Meta

JUNE 12, 2024

Meta runs different types of backend networks, topologies, and training jobs that have tight dependencies between software and hardware components. Instead, we ensure components are compatible with each other and roll component upgrades up in a sliding fashion. This transition has not been without its challenges.

Fashion 138

Fashion Data Centers Artificial Intelligence Server 138

Engineering at Meta

MARCH 12, 2024

It played and continues to play an important role in the development of Llama and Llama 2 , as well as advanced AI models for applications ranging from computer vision, NLP, and speech recognition, to image generation , and even coding. Under the hood Our newer AI clusters build upon the successes and lessons learned from RSC.

Infiniband 145

Infiniband Data Centers Server Network 145

Confluent

MAY 9, 2019

Storing events in a stream and connecting streams via stream processors provide a generic, data-centric, distributed application runtime that you can use to build ETL, event streaming applications, applications for recording metrics and anything else that has a real-time data requirement. Let’s explore what this really means.

Application 94

Application Topology DevOps Fashion 94

Confluent

FEBRUARY 13, 2019

Although the principles behind event-driven frameworks are sound, those behind event sourcing, CQRS and hydrating application state are separate concerns so we often see them handled explicitly as an orthogonal concern (e.g., operational processes) or externally (think GitHub for your applications state). Scaling mechanism.

Application 92

Application Protocol Topology Fashion 92

Kentik

MAY 15, 2017

In a similar fashion, Facebook recently published a blog describing their Express Backbone that provides internal connectivity between datacenters. The system then dynamically provisions an MPLS LSP topology to meet the observed loads while optimizing for various traffic classes (e.g. latency sensitive vs. insensitive).

Network 40

Network Networking Fashion Topology 40