Engineering at Meta

DECEMBER 6, 2023

We are beginning to upgrade people’s personal conversations on Messenger to use end-to-end encryption (E2EE) by default Meta is publishing two technical white papers on end-to-end encryption: Our Messenger end-to-end encryption whitepaper describes the core cryptographic protocol for transmitting messages between clients. The Labyrinth encrypted storage protocol whitepaper explains our protocol for end-to-end encrypting stored messaging history between devices on a user’s account.

Encryption 145

Encryption Protocol Server Application 145

databricks

OCTOBER 12, 2023

In this blog post, the MosaicML engineering team shares best practices for how to capitalize on popular open source large language models (LLMs).

Engineering 159

Engineering 159

Confluent

JUNE 8, 2023

ChatGPT and data streaming can work together for any company. Learn a basic framework for using GPT-4 and streaming to build a real-world production application.

Application 145

Application 145

Jane Street

SEPTEMBER 12, 2023

We’re once again at the end of our internship season, and it’s my taskto provide a few highlights of what the dev interns accomplished whilethey were here.

143

143

Kentik

APRIL 10, 2023

This February marked a grim milestone in the ongoing war in Ukraine. It has now been over a year since Russian forces invaded its neighbor to the west leading to the largest conflict in Europe since World War II. In the past year, we have used Kentik’s unique datasets to show some of the conflict’s impacts on Ukraine’s external internet connectivity, ranging from DDoS attacks and large outages , to the rerouting of internet service in the southern region of Kherson.

Internet 145

Internet IP Address Server Telecommunications 145

InfoQ Articles

APRIL 7, 2023

This article provides an overview of how the InfoQ editorial team sees the Software Architecture and Design topic evolving in 2023, with a focus on what architects are designing for today.

Blockchain 145

Blockchain Artificial Intelligence 145

DoorDash Engineering

MARCH 14, 2023

When dealing with failures in a microservice system, localized mitigation mechanisms like load shedding and circuit breakers have always been used, but they may not be as effective as a more globalized approach. These localized mechanisms ( as demonstrated in a systematic study on the subject published at SoCC 2022 ) are useful in preventing individual services from being overloaded, but they are not very effective in dealing with complex failures that involve interactions between services, whic

Engineering 135

Engineering Application Protocol Server 135

Mixpanel

JANUARY 4, 2023

Customer Focus is one of our core cultural values at Mixpanel. We respect our customers’ time and strive to make buying software as seamless and frictionless as subscribing to your favorite music streaming service. That’s why we’ve made all of Mixpanel’s plans available for purchase online with our pricing clearly listed on our website. This removes the friction of customers having to schedule a call with a sales rep, negotiating on price, and the many other steps that completing a B2B software

B2B 133

B2B B2C Email 133

Dataversity

SEPTEMBER 13, 2023

Cloud computing has enabled many organizations to improve the scalability and flexibility of a variety of crucial business functions. As migration to cloud-based solutions gains momentum, understanding the total cost of cloud adoption is crucial. Cloud economics, in particular, is a framework that has been tailored to evaluate and enhance the financial dimensions of harnessing […] The post How Cloud Economics Help Businesses Build Cyber Resilience in the Cloud appeared first on DATAVERSITY

Cloud 130

Cloud Financial Education 130

TDAN

SEPTEMBER 5, 2023

Harnessing the power of data has become critical in today’s digital age when information is abundant and decision-making is critical in many aspects of business. Understanding your data may unearth hidden insights and move your business ahead, whether you’re a small startup or an established enterprise.

Government 128

Government Education 128

Engineering at Meta

DECEMBER 19, 2023

On July 5, 2023, Meta launched Threads, the newest product in our family of apps, to an unprecedented success that saw it garner over 100 million sign ups in its first five days. A small, nimble team of engineers built Threads over the course of only five months of technical work. While the app’s production launch had been under consideration for some time, the business finally made the decision and informed the infrastructure teams to prepare for its launch with only two days’ advance notice.

Engineering 144

Engineering Server Data Centers Protocol 144

databricks

JUNE 29, 2023

Introduction We are thrilled to unveil the English SDK for Apache Spark, a transformative tool designed to enrich your Spark experience. Apache Spark™.

145

145

Confluent

MAY 15, 2023

Take a tour of the internals of Confluent’s Apache Kafka® service, powered by Kora: the next-generation, cloud-native streaming engine.Kora.

Cloud 145

Cloud Engineering 145

High Scalability

FEBRUARY 22, 2023

This is a guest article by NK. You can view the original article Consistent hashing explained on systemdesign.one website. How does consistent hashing work?

IP Address 124

IP Address 124

Kentik

FEBRUARY 22, 2023

Last summer we teamed up with the New York Times to analyze the re-routing of internet service to Kherson, a region in southern Ukraine that was, at the time, under Russian occupation. In my accompanying blog post , I described how that development mirrored what took place following Russia’s annexation of Crimea in 2014. Along with the Russian-held parts of eastern Ukraine, these regions have experienced a type of Russification , an assimilation where the Ukrainian residents of these regions hav

IP Address 144

IP Address Internet VPN Networking 144

InfoQ Articles

DECEMBER 13, 2023

Knowing about potential software architecture pitfalls can help teams by keeping them away from tempting paths that will not take them where they want to go. This article covers some of those pitfalls, and provides guidance on how they can be avoided.

138

138

DoorDash Engineering

MARCH 21, 2023

While building a feature store to handle the massive growth of our machine-learning (“ML”) platform, we learned that using a mix of different databases can yield significant gains in efficiency and operational simplicity. We saw that using Redis for our online machine-learning storage was not efficient from a maintenance and cost perspective.

Engineering 132

Engineering Cloud 132

Faris Malaeb

JULY 7, 2023

Outlook users may face an issue when trying to connect to Exchange Server, where Outlook won’t start and instead shows the following error message “Cannot Start Microsoft Outlook. Cannot open the Outlook Window. The set of folders cannot be opened. The attempt to log on to Microsoft Exchange has failed“ In this post, you will. The post QuickFix: Cannot Start Microsoft Outlook.

Server 130

Server 130

Mixpanel

JULY 6, 2023

The rules of SaaS are changing. For so long, using the apps and services we need to be productive has required technical formulas or exhausting interfaces. Generative AI is unframing all of that. Have some scratch notes you’d like expanded into a new product requirements document (PRD)? You can now click a button to get AI to write and organize it for you.

129

129

Dataversity

DECEMBER 18, 2023

Analytics at the core is using data to derive insights for measuring and improving business performance [1]. To enable effective management, governance, and utilization of data and analytics, an increasing number of enterprises today are looking at deploying the data catalog, semantic layer, and data warehouse. But what exactly are these data and analytics tools […] The post Data Catalog, Semantic Layer, Data Warehouse: The Three Key Pillars of Enterprise Analytics appeared first on DATAVE

Government 119

Government Education 119

Eventbrite

JANUARY 5, 2023

In these belt-tightened times, savvy event organizers are looking for new ways to boost their revenue. Here are 5 proven ways to bring in additional income from your event.

119

119

Engineering at Meta

APRIL 6, 2023

Buck2, our new open source, large-scale build system , is now available on GitHub. Buck2 is an extensible and performant build system written in Rust and designed to make your build experience faster and more efficient. In our internal tests at Meta, we observed that Buck2 completed builds 2x as fast as Buck1. Buck2, Meta’s open source large-scale build system, is now publicly available via the Buck2 website and the Buck2 GitHub repository.

Engineering 145

Engineering Server 145

databricks

APRIL 11, 2023

Two weeks ago, we released Dolly, a large language model (LLM) trained for less than $30 to exhibit ChatGPT-like human interactivity (aka instruction-following).

145

145

Confluent

JANUARY 6, 2023

Introducing fully managed Apache Kafka® + Flink for the most robust, cloud-native data streaming platform with stream processing, integration, and streaming analytics in one.

Cloud 145

Cloud 145

TDAN

OCTOBER 3, 2023

As a frequent reviewer of data and strategy books, I am always interested in understanding authors’ perspectives on data governance. Two recent books have ideas that are worthy of data governance professionals: “Rewired” by Eric Lamarre, Kate Smaje, and Rodney W. Zemmel; and “Data Is Everybody’s Business” by Barbara H. Wixom, Cynthia M.

Government 116

Government Education 116

Jane Street

AUGUST 29, 2023

At Jane Street, we often work with data that has a very lowsignal-to-noise ratio, but fortunately we also have a lot of data.Where practitioners in many fiel.

111

111

InfoQ Articles

JANUARY 25, 2023

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator.

Engineering 142

Engineering 142

DoorDash Engineering

FEBRUARY 22, 2023

As DoorDash made the move from made-to-order restaurant delivery into the Convenience and Grocery (CnG) business, we had to find a way to manage an online inventory per merchant per store that went from tens of items to tens of thousands of items. Having multiple CnG merchants on the platform means constantly refreshing their offerings, a huge inventory management problem that would need to be operated at scale.

Engineering 125

Engineering Server Bandwidth Application 125

Faris Malaeb

MAY 27, 2023

The Get-IISAppPool cmdlet helps to access and configure Internet Information Services (IIS) application pools. This cmdlet is available within the IISAdministration PowerShell module. It enables users to retrieve information, such as application pool name,Net framework version, runtime version, state, and recycling settings of an existing IIS application pool.

Internet 130

Internet Application 130

Mixpanel

MAY 2, 2023

Mixpanel launched over a decade ago as an analytics tool for product teams. But here’s a little secret: More than half of our users today are actually on marketing teams. There are two reasons why. Product and marketing teams have to collaborate very closely to drive growth, especially when the goal is product-led growth (PLG). That makes it important to use the same analytics tool.

Media 119

Media Network Networking 119

Dataversity

NOVEMBER 6, 2023

Hello! I’m Mark Horseman, and welcome to The Cool Kids Corner. This is my monthly check-in to share with you the people and ideas I encounter as a data evangelist with DATAVERSITY. (Read last month’s column here.) This month we’re talking about Data Quality (DQ). Data Quality, the phrase “garbage in, garbage out,” dirty data, data […] The post The Cool Kids Corner: Data Quality Is Not a Fish You Can Catch appeared first on DATAVERSITY.

Government 119

Government Education 119

Kentik

FEBRUARY 8, 2023

Traffic telemetry is the data collected from network devices and used for analysis. With traffic telemetry, engineers can gain real-time visibility into traffic patterns, correlate events, and make predictions of future traffic patterns. As a critical input to a network observability platform, this data can help monitor and optimize network performance, troubleshoot issues, and detect security threats.

Networking 111

Networking Network Port IP Address 111

Engineering at Meta

SEPTEMBER 7, 2023

Earlier this year, a small team of engineers at Meta started working on an idea for a new app. It would have all the features people expect from a text-based conversations app, but with one very key, distinctive goal – being an app that would allow people to share their content across multiple platforms. We wanted to build a decentralized (or federated) app that would enable people to post content that is viewable by anyone on other social apps, and vice versa.

Email 143

Email Engineering Media Protocol 143

databricks

OCTOBER 30, 2023

Introduction Four months ago, we shared how AMD had emerged as a capable platform for generative AI and demonstrated how to easily and.

Engineering 142

Engineering 142

Confluent

MAY 11, 2023

Running Kafka is costly, but Confluent has created a far more efficient product to lower your costs. Join the Cost Savings challenge to see for yourself.

142

142

Eventbrite

FEBRUARY 22, 2023

An Excel spreadsheet full of data on ticket sales, budget, and registration information can be an incredibly helpful resource as you plan your event. By using Excel for your event planning, you’ll discover it’s more than a simple event checklist. It’s a versatile application with plenty of tools to help with event management.

Application 105

Application 105

Ben Morris

SEPTEMBER 2, 2023

How should you go about building an architecture practice in organisations where people are allowed to say no? Ultimately, this becomes an exercise in persuasion, pragmatism, and patience.

100

100