article thumbnail

Article: Migrate a RMI-Based Legacy Application to WebSocket

InfoQ Articles

This article provides a use case related to removing technical debt in a large enterprise application based on an old fashioned Remote Method Invocation (RMI) protocol, and migrating it toward modern cloud-aware communication technologies. By Bartolomeo Sorrentino

article thumbnail

How Meta trains large language models at scale

Engineering at Meta

Optimal connectivity between GPUs: Large-scale model training involves transferring vast amounts of data between GPUs in a synchronized fashion. Solving this problem requires a robust and high-speed network infrastructure as well as efficient data transfer protocols and algorithms. Both of these options had tradeoffs.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

A RoCE network for distributed AI training at scale

Engineering at Meta

This backend fabric utilizes the RoCEv2 protocol, which encapsulates the RDMA service in UDP packets for transport over the network. Initially, our GPU clusters used a simple star topology with a few AI racks connected to a central Ethernet switch running the non-routable RoCEv1 protocol.

Network 132
article thumbnail

IPLS: Privacy-preserving storage for your WhatsApp contacts

Engineering at Meta

IPLS incorporates new privacy technology that protects your contact lists in a privacy-preserving fashion. The Key Vault verifies the client identity key by accessing AKD via a secure cryptographic protocol and verifying that the client has the corresponding private key.

article thumbnail

The WAN Accelerator and Modern Network Optimization

CATO Networks

Compression, in the context of WAN acceleration, typically operates at the byte-level and works in a similar fashion to file compression but applies to data in transit. Protocol acceleration techniques improve protocol operation across the network, particularly in terms of reducing the latency introduced by inefficient protocol operation.

WAN 52
article thumbnail

Journey to Event Driven – Part 2: Programming Models for the Event-Driven Architecture

Confluent

In order to facilitate this functionality the underlying protocol needs to ensure qualities such as offline status, different consumer rates, high throughput, low latency and elasticity (amongst others). In some cases, it is desirable to hide these protocol concerns. In such cases we recommend the StreamProcessor approach.

article thumbnail

NetOps for Application Developers: Understanding the Importance of Network Operations in Modern Development

Kentik

Having an expert perspective on network protocols helps ensure data will be moved securely and with network performance in mind. Cross-functional teams One way to ensure architectural decisions include the perspective of both application and network specialists is to create cross-functional teams.