article thumbnail

HN728: How Drivenets Leverages Ethernet Fabrics For AI Networking (Sponsored)

Packet Pushers

While there are advantages to using Ethernet for AI networking (including engineers well-trained in the protocol and a robust ecosystem), it wasnt designed. Read more » To run AI workloads, a network needs thousands of GPUs and those GPUs must operate in sync. Read more »

article thumbnail

A RoCE network for distributed AI training at scale

Engineering at Meta

AI networks play an important role in interconnecting tens of thousands of GPUs together, forming the foundational infrastructure for training, enabling large models with hundreds of billions of parameters such as LLAMA 3.1 The growing prevalence of AI has introduced a new era of communication demands.

article thumbnail

Robotcop: enforcing your robots.txt policies and stopping bots before they reach your website

CloudFaire

You can now quickly see which AI services are honoring your robots.txt policies, which arent, and then programmatically enforce these policies. Robots.txt is a plain text file hosted on your domain that implements the Robots Exclusion Protocol , a standard that has been around since 1994. What is robots.txt?