A RoCE network for distributed AI training at scale
Engineering at Meta
AUGUST 5, 2024
ECMP and path pinning We initially considered the widely adopted ECMP, which places flows randomly based on the hashes on the five-tuple: source and destination IPs, source and destination UDP ports, and protocol. However, and as expected, ECMP rendered poor performance for the training workload due to the low flow entropy.
132 
Let's personalize your content