Engineering at Meta

JUNE 12, 2024

Optimal connectivity between GPUs: Large-scale model training involves transferring vast amounts of data between GPUs in a synchronized fashion. Solving this problem requires a robust and high-speed network infrastructure as well as efficient data transfer protocols and algorithms.

Infiniband 141

Infiniband Data Centers Topology Networking 141

Engineering at Meta

AUGUST 5, 2024

This backend fabric utilizes the RoCEv2 protocol, which encapsulates the RDMA service in UDP packets for transport over the network. Initially, our GPU clusters used a simple star topology with a few AI racks connected to a central Ethernet switch running the non-routable RoCEv1 protocol.

Networking 132

Networking Network Topology Data Centers 132

Confluent

FEBRUARY 13, 2019

The broker sizing is a function of the total sum of partitions across the number of servers and replicas. Consumers in this context are anything that requests data; they could be stream processors, Java or.NET applications or KSQL server nodes. In some cases, it is desirable to hide these protocol concerns.

Application 92

Application Protocol Topology Fashion 92

Cloudera Blog

FEBRUARY 28, 2024

It contains the name (alias), address (bootstrap servers), and credentials that SRM can use to access a specific cluster. The setup in this tutorial is minimal and unsecure, so you only need to configure Name, Bootstrap Servers, and Security Protocol lines. The security protocol in this case is PLAINTEXT.

Protocol 70

Protocol Fashion Server Application 70

Kentik

APRIL 16, 2023

Having an expert perspective on network protocols helps ensure data will be moved securely and with network performance in mind. Cross-functional teams One way to ensure architectural decisions include the perspective of both application and network specialists is to create cross-functional teams.

Application 64

Application DevOps Networking Network 64

Confluent

FEBRUARY 27, 2019

Stream processors allow us to work natively with these streams in a “correct” fashion by supporting a myriad of patterns with either bespoke logic, such as Kafka Streams, or a higher order grammar: KSQL. VM, container, server. Stream patterns (fan out, fan in/join). Consumption based. FaaS provider. Runtime limits. 3,008 MB memory.

Cloud 109

Cloud Application Gateway Protocol 109

SysAdmin1138 Explains

NOVEMBER 22, 2024

What this means for the future of telemetry and observability Telemetry over the last 60 years of computing has gone from digging through the SYSLOG printout from one of your two servers, to digging through /var/log/syslog, to the creation of dedicated metrics systems, to the creation of tracing techniques. NFS shares for Syslog.

Engineering 52

Engineering Fashion Server Protocol 52