Engineering at Meta

MARCH 6, 2024

Implementing an end-to-end encrypted protocol First, we need to protect the underlying security that keeps communication on Meta E2EE messaging apps secure: the encryption protocol. WhatsApp and Messenger both use the tried and tested Signal protocol as a foundational piece for their encryption.

Protocol 135

Protocol Encryption Server Media 135

ByteByteGo

JANUARY 25, 2025

The zero flakes guarantee cuts out false alarms and wasted engineering hours. Youtube video) The Ultimate API Learning Roadmap 30 Useful AI Apps That Can Help You in 2025 10 Essential Components of a Production Web Application How do we design effective and safe APIs? Code First v.s. API First Oauth 2.0

Cookie 173

Cookie Gateway Server Application 173

Cloudera Blog

OCTOBER 8, 2024

Enterprise developers began exploring proof of concepts (POCs) for generative AI applications, leveraging API services and open models such as Llama 2 and Mistral. Businesses are now allocating dedicated budgets and building infrastructure to support AI applications in real-world environments.

Application 75

Application Government Protocol Cloud 75

NW Kings

DECEMBER 16, 2024

The protocols of transport layer play a significant role in data transmission across the network, ensuring reliable communication between sender and receiver. This blog will explore the key protocols within the transport layer, focusing on TCP ( Transmission Control Protocol ) and UDP (User Datagram Protocol) in detail.

Protocol 40

Protocol TCP Port Network 40

Engineering at Meta

DECEMBER 6, 2023

We are beginning to upgrade people’s personal conversations on Messenger to use end-to-end encryption (E2EE) by default Meta is publishing two technical white papers on end-to-end encryption: Our Messenger end-to-end encryption whitepaper describes the core cryptographic protocol for transmitting messages between clients.

Encryption 145

Encryption Protocol Server Application 145

CATO Networks

APRIL 30, 2020

New applications are identified faster, more efficiently by using data science and Catos data warehouse Identifying applications has become a crucial part of network operations. However, legacy approaches to application classification have become too ineffective or too expensive. Its costly, lengthy, and limited in accuracy.

Application 52

Application Port Protocol Firewall 52

ByteByteGo

DECEMBER 21, 2024

They are used for websites and services that support the IPv6 protocol. This makes webhooks ideal for dealing with real-time updates because data is pushed to your application as soon as it’s available. Webhooks are recommended for applications that need instant data delivery. API Vs SDK! What's yours?

DNS 130

DNS IP Address Server Email 130

Kentik

APRIL 16, 2023

One of the great successes of software development in the last ten years has been the relatively decentralized approach to application development made available by containerization, allowing for rapid iteration, service-specific stacks, and (sometimes) elegant deployment and orchestration implementations that piece it all together.

Application 64

Application DevOps Network Networking 64

NW Kings

JANUARY 4, 2025

Are you looking to kickstart your career as a (network engineer)? Starting with Network Engineer Roadmap with Cisco CCNA The first step on your journey is to obtain the CCNA (Cisco Certified Network Associate) certification. Although the material may (seem) dense at times, it becomes clearer with practical application.

Engineering 52

Engineering Network Networking Data Centers 52

DoorDash Engineering

JANUARY 31, 2023

One of the biggest immediate standouts was the time we spent on Swift protocol conformance checks (checking if a type conforms to a protocol), but why? The problem is that we used String(describing:) to identify services, which came with a runtime performance penalty of checking if the type conforms to various other protocols.

Protocol 114

Protocol Application Engineering Networking 114

Engineering at Meta

DECEMBER 19, 2023

A small, nimble team of engineers built Threads over the course of only five months of technical work. ZippyDB: Scaling keyspaces for Threads Let’s zoom in on the storage layer, where we leveraged ZippyDB, a distributed key/value database that is run as a fully managed service for engineers to build on.

Engineering 144

Engineering Server Data Centers Protocol 144

CloudFaire

DECEMBER 30, 2024

Internet protocol specifications are instructions designed for engineers to build things. Protocol designers take great care to ensure the documents they produce are clear. Any reasonably skilled engineer should be able to take a specification and produce a performant, reliable, and secure implementation.

Protocol 101

Protocol Server Internet TCP 101

Engineering at Meta

NOVEMBER 21, 2022

Implementing Precision Time Protocol (PTP) at Meta allows us to synchronize the systems that drive our products and services down to nanosecond precision. Network card Our ultimate goal is to make protocols such as PTP propagate over the packet network. Every time-sensitive PTP packet gets hardware timestamped by the NIC.

Protocol 57

Protocol Server Unicast Network 57

Engineering at Meta

AUGUST 5, 2024

This backend fabric utilizes the RoCEv2 protocol, which encapsulates the RDMA service in UDP packets for transport over the network. Initially, our GPU clusters used a simple star topology with a few AI racks connected to a central Ethernet switch running the non-routable RoCEv1 protocol.

Network 132

Network Networking Topology Data Centers 132

Kentik

APRIL 4, 2023

More than anything, reliability becomes the principal challenge for network engineers working in and with the cloud. Even the most detailed reliability engineering can be easily undermined in an insecure network. While there is much to be said about cloud costs and performance , I want to focus this article primarily on reliability.

Cloud 104

Cloud Network Networking Bandwidth 104

Nextdoor Engineering

FEBRUARY 2, 2022

At Nextdoor, the written version of these engineering principles is new; however, the principles themselves are not. Our goal in sharing these with the broader engineering community is so we can help learn from oneanother. We want all new engineers to learn and apply our engineering principles quickly.

Engineering 52

Engineering Energy Protocol Advertising 52

Kentik

MARCH 15, 2023

Distributed denial of service (DDoS) DDoS attacks are cyber attacks that most often have the purpose of causing application downtime. Protocol-based. These attacks overwhelm network infrastructure resources, targeting layer 3 and layer 4 communication protocols. Application layer.

Network 94

Network Networking Protocol IP Address 94

Engineering at Meta

JUNE 11, 2024

With a lack of common patterns for config usage, there are anti-patterns where engineers reinvent the wheel or build ad hoc ways of fetching configuration that are very specific for each app. In these cases, we use several technologies and protocols, such as IPC and SPI, to sync configuration values to the various components.

Real Estate 99

Real Estate Protocol Application Engineering 99

Engineering at Meta

SEPTEMBER 7, 2023

Arcadia gives Meta’s researchers and engineers valuable insights into the performance of AI models and workloads in an AI cluster – enabling data-driven decision making in the design of AI clusters. Our multi-layered system : At Meta, we control the stack from physical network to applications.

Topology 112

Topology Network Networking Application 112

ByteByteGo

NOVEMBER 30, 2024

Unlimited: Unlimited IDPs, unlimited users, unlimited tenants, unlimited applications, always free. With each iteration, the protocol has evolved in new and interesting ways. The protocol was built on top of TCP and provided a reliable way of communication over the World Wide Web. the very next year.

TCP 100

TCP Protocol Server Email 100

Confluent

MAY 7, 2019

Understanding the details of how Kafka consumers work will make you an all-around better Kafka developer so that you can troubleshoot and build reliable applications more effectively. That order gets propagated to Kafka and processed by an application that registers it on the New York Stock Exchange via the NYSE API.

Protocol 111

Protocol Application Financial Server 111

Zynga

FEBRUARY 28, 2022

Engineering games involves a deep understanding of multiple technologies, building highly dynamic content, interacting with multiple disciplines and having a constant eye on how the game impacts players in every way. Below are some of the key advantages and experiences one could gain by working on engineering within the games industry.

Engineering 52

Engineering 5G B2C Blockchain 52

Kentik

OCTOBER 12, 2021

When I first entered the networking industry right out of college, many applications sent passwords over the network in clear text, unencrypted. This made accurately monitoring latency and packet loss to some applications impossible. The NPM goal is still to improve the overall end-user experience with their applications.

Encryption 84

Encryption DNS IP Address Protocol 84

Engineering at Meta

MAY 22, 2024

In recent years, Meta’s data management systems have evolved into a composable architecture that creates interoperability, promotes reusability, and improves engineering efficiency. Over time, these divergent systems created a fragmented data environment with little reuse across systems, which eventually slowed our engineering innovation.

Engineering 104

Engineering Port Data Centers Protocol 104

Confluent

MAY 22, 2019

What protocols do the devices use to communicate? Most IoT-based applications (both B2C and B2B) are typically built in the cloud as microservices and have similar characteristics. This information can then be sent over the network back to the central application. For delivering this data one widely used protocol is MQTT.

IoT 98

IoT Protocol Application Internet 98

Engineering at Meta

FEBRUARY 20, 2024

We’ve partnered with Voltron Data and the Arrow community to align and converge Apache Arrow with Velox , Meta’s open source execution engine. More recently, a variety of feature engineering, data preprocessing, and training systems were built to support our rapidly expanding AI/ML infrastructure.

Engineering 112

Engineering Protocol Application Networking 112

Confluent

APRIL 23, 2019

At Confluent, we have an engineering team dedicated to the development of these Kafka clients. …and others… Many of these extensions are built on the C client library for the Kafka protocol called librdkafka , which is itself maintained and supported by Confluent and recently reached v1.0.0.

Cloud 102

Cloud Protocol Engineering Application 102

DoorDash Engineering

OCTOBER 24, 2023

Native applications can take weeks to roll out whereas web rollouts can be accomplished immediately. So, we decided to build a common web app that can be hosted within the native application to provide an in-app experience while also providing the flexibility to make rapid changes. The backend service stores and serves the content.

Server 83

Server JavaScript Protocol Application 83

Kentik

MARCH 9, 2023

Traditional network monitoring relies on telemetry sources such as Simple Network Messaging Protocol (SNMP), sFlow, NetFlow, CPU, memory, and other device-specific metrics. With so many network boundaries being navigated (application, service, cloud providers, subnets, SD-WANs , etc.), What is device telemetry?

Network 97

Network Networking Bandwidth IoT 97

Engineering at Meta

JANUARY 26, 2023

Here, we discuss the engineering, scaling, and nontechnical challenges of modernizing Meta’s exabyte-scale data platform by migrating to the new Tulip format. This involved engineering the wire format for a smooth transition as well as arming various systems with format converters and adapters where necessary.

Engineering 111

Engineering Application Protocol 111

Network Engineering

DECEMBER 21, 2015

Also, I was reading about Transport layer protocol when this line caught my eye: More than one transport layer protocol may be available to network applications. For example, the internet has two protocols - TCP and UDP. I doubt that those even had a Transport layer protocol.

Internet 52

Internet Protocol Network Networking 52

ByteByteGo

DECEMBER 14, 2024

→ Enterprise SSO that supports any identity provider that uses SAML or OIDC protocols. Say goodbye to managing infrastructure and focus on building real-time, scalable systems that focus on building critical real-time applications. Load Testing This tests applications’ performance by simulating different loads.

Application 100

Application B2B JavaScript Cloud 100

Confluent

OCTOBER 10, 2019

For instance, one application might already send data to an MQTT broker so that you can consume from there while another project does not use an MQTT broker at all, and you just want to push the data into the event streaming platform directly for further processing. Examples are S7, PROFINET, Modbus, or an automated dispatch system (ADS).

IoT 20

IoT Internet Protocol Cloud 20

Cloudera Blog

DECEMBER 9, 2024

Designed to handle the demands of real-time applications, this service supports a wide range of models, from traditional predictive models to advanced generative AI (GenAI), such as large language models (LLMs) and embedding models. This flexibility allows you to select the best models for your specific use cases.

Application 75

Application Engineering Healthcare Protocol 75

Engineering at Meta

APRIL 13, 2023

Key transparency solutions help strengthen the guarantee that end-to-end encryption provides to private, personal messaging applications in a transparent manner available to all. Enter key transparency : A protocol in which we establish an AKD on WhatsApp that maintains a record of public key changes.

Encryption 144

Encryption Server Protocol Application 144

Engineering at Meta

AUGUST 7, 2023

On the edge, our Transport Layer Security (TLS) deployment helps ensure end-to-end security for our applications over the internet. When a client (an app or browser), wants to send a request to a dynamic application, it first needs to complete a TLS handshake with our L7 load balancer Proxygen in the PoP to obtain a secure connection.

Protocol 96

Protocol Engineering Internet Networking 96

Engineering at Meta

OCTOBER 22, 2024

Certain events associated with your phone’s WhatsApp application (such as installing or reinstalling) trigger the creation of a new cryptographic keypair that is associated with your phone number. The post IPLS: Privacy-preserving storage for your WhatsApp contacts appeared first on Engineering at Meta.

Encryption 109

Encryption Fashion Data Centers Protocol 109