Bandwidth Network Topology 
Engineering at Meta
AUGUST 5, 2024
AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 Distributed training, in particular, imposes the most significant strain on data center networking infrastructure.
Engineering at Meta
SEPTEMBER 7, 2023
Meta presents Chakra execution traces , an open graph-based representation of AI/ML workload execution, laying the foundation for benchmarking and network performance optimization. At Meta, our endeavors are not only geared towards pushing the boundaries of AI/ML but also towards optimizing the vast networks that enable these computations.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Kentik
APRIL 4, 2023
When evaluating solutions, whether to internal problems or those of our customers, I like to keep the core metrics fairly simple: will this reduce costs, increase performance, or improve the network’s reliability? It’s often taken for granted by network specialists that there is a trade-off among these three facets. Durability.
Engineering at Meta
JUNE 12, 2024
Supporting GenAI at scale has meant rethinking how our software, hardware, and network infrastructure come together. Solving this problem requires a robust and high-speed network infrastructure as well as efficient data transfer protocols and algorithms. requires revisiting trade-offs made for other types of workloads.
Kentik
AUGUST 30, 2021
If you haven’t yet heard the term “network observability,” you will be hearing it soon. Some say that network observability is just marketing hype from vendors. They say, “networks have always been observable, so there’s nothing new here.” I say network observability is not just vendor hype, and this blog will make the case.
Kentik
MARCH 15, 2023
As networks become distributed and virtualized, the points at which they can be made vulnerable, or their threat surface , expands dramatically. This is compounded by recent trends of remote work, where network operators need to wrestle with the fact that employees often access the network via work sites with far less governance.
Kentik
SEPTEMBER 20, 2021
Latency is not a new problem in networking. Not as difficult as time travel, but it’s difficult enough so that for 30+ years IT professionals have tried to skirt the issue by adding more bandwidth between locations or by rolling out faster routers and switches. Fast forward to today, most networks enjoy five nines (99.999%) of uptime.
Expert insights. Personalized for you.
132 
Let's personalize your content