Engineering at Meta

AUGUST 5, 2024

We ensure that there is enough ingress bandwidth on the rack switch to not hinder the training workload. The BE is a specialized fabric that connects all RDMA NICs in a non-blocking architecture, providing high bandwidth, low latency, and lossless transport between any two GPUs in the cluster, regardless of their physical location.

Network 124

Network Networking Topology Data Centers 124

Engineering at Meta

MARCH 12, 2024

It played and continues to play an important role in the development of Llama and Llama 2 , as well as advanced AI models for applications ranging from computer vision, NLP, and speech recognition, to image generation , and even coding. Under the hood Our newer AI clusters build upon the successes and lessons learned from RSC.

Infiniband 145

Infiniband Data Centers Server Network 145

CATO Networks

MAY 4, 2020

While WAN optimization and acceleration are still important, increased bandwidth availability, cloud, and mobile have significantly shifted the paradigm. What is a WAN accelerator Simply put, a WAN accelerator is any hardware or software appliance that provides bandwidth optimization across a WAN. Here, well answer those questions.

WAN 52

WAN Networking Network Bandwidth 52

High Scalability

NOVEMBER 25, 2019

Large files or low bandwidth. Application Servers. At this point, we store 1 DR copy in public cloud and 1 copy with us but eventually we will use our data center as a pass-through cache as compute is cheaper in the cloud but bandwidth is expensive. Document store. Video Transcoding. Permissions. Recommendations. Hybrid Sync.

Data Centers 21

Data Centers Server Engineering Cloud 21