Infiniband Protocol Topology 
Engineering at Meta
JUNE 12, 2024
Solving this problem requires a robust and high-speed network infrastructure as well as efficient data transfer protocols and algorithms. This requires robust and high-speed network infrastructure as well as efficient data transfer protocols and algorithms. This has encompassed developments in a wide range of areas.
Engineering at Meta
AUGUST 5, 2024
Topology We built a dedicated backend network specifically for distributed training. To support large language models (LLMs), we expanded the backend network towards the DC-scale, e.g., incorporating topology-awareness into the training job scheduler. We designed a two-stage Clos topology for AI racks, known as an AI Zone.
Expert insights. Personalized for you.
141 
Let's personalize your content