Engineering at Meta

AUGUST 5, 2024

We ensure that there is enough ingress bandwidth on the rack switch to not hinder the training workload. The BE is a specialized fabric that connects all RDMA NICs in a non-blocking architecture, providing high bandwidth, low latency, and lossless transport between any two GPUs in the cluster, regardless of their physical location.

Networking 132

Networking Network Topology Data Centers 132

Engineering at Meta

MARCH 12, 2024

This solution enables thousands of GPUs to save and load checkpoints in a synchronized fashion (a challenge for any storage solution) while also providing a flexible and high-throughput exabyte scale storage required for data loading. This helped push our large clusters to achieve great and expected performance just as our small clusters.

Infiniband 145

Infiniband Data Centers Server Networking 145

Engineering at Meta

JUNE 12, 2024

Optimal connectivity between GPUs: Large-scale model training involves transferring vast amounts of data between GPUs in a synchronized fashion. We optimized the RoCE cluster for quick build time, and the InfiniBand cluster for full-bisection bandwidth. Our intent was to build and learn from the operational experience.

Infiniband 141

Infiniband Data Centers Topology Networking 141

CATO Networks

MAY 4, 2020

While WAN optimization and acceleration are still important, increased bandwidth availability, cloud, and mobile have significantly shifted the paradigm. What is a WAN accelerator Simply put, a WAN accelerator is any hardware or software appliance that provides bandwidth optimization across a WAN. Here, well answer those questions.

WAN 52

WAN Networking Network Bandwidth 52

Akins IT

OCTOBER 30, 2020

I think it's old fashioned wiring to just show up at the office every day. I also had a full house going on with a family of six which made decent internet bandwidth hard to come by. For the first couple of months of quarantine, I still went in to the office every day and worked there solo.

Fashion 52

Fashion Education Bandwidth Internet 52

DoorDash Engineering

JANUARY 23, 2024

Second, approvals would consume far too much bandwidth from platform team engineers. All current platform clients are T0 service, have fallbacks in place, and can perform in a degraded fashion if the platform becomes unavailable. First, the platform team doesn’t have insights about the type of changes being requested.

Engineering 74

Engineering Fashion Bandwidth 74

High Scalability

NOVEMBER 25, 2019

Large files or low bandwidth. At this point, we store 1 DR copy in public cloud and 1 copy with us but eventually we will use our data center as a pass-through cache as compute is cheaper in the cloud but bandwidth is expensive. We have cache filers nodes based on tomcat/Nginx/local file system and it acts in LRU fashion.

Data Centers 21

Data Centers Server Engineering Cloud 21