DoorDash Engineering

MARCH 14, 2023

When dealing with failures in a microservice system, localized mitigation mechanisms like load shedding and circuit breakers have always been used, but they may not be as effective as a more globalized approach. These localized mechanisms ( as demonstrated in a systematic study on the subject published at SoCC 2022 ) are useful in preventing individual services from being overloaded, but they are not very effective in dealing with complex failures that involve interactions between services, whic

Engineering 135

Engineering Application Protocol Server 135

Confluent

MARCH 28, 2023

The future of data is real time and enriched by machine learning. How can we overcome socio-technical blockers and unite the ML and data streaming markets?

133

133

Faris Malaeb

MARCH 19, 2023

PowerShell scripting is an essential skill each sysadmin has to know as it provides an efficient and reliable way to automate IT tasks. When it comes to using AI technology to enhance PowerShell scripting, two of the most prominent options are Bing AI and ChatGPT. While both offer unique features and benefits, it’s important to. The post Bing AI VS.

130

130

InfoQ Articles

MARCH 21, 2023

This article describes a framework for making architectural decisions using three building blocks: The company's own Technology Radar; Technology Standards; and Architecture Decision Records (ADRs). The framework clarifies decision-making, team involvement, and information on already made decisions and aligns with the company's needs and culture.

128

128

databricks

MARCH 6, 2023

ML Virtual Event Enabling Production ML at Scale With Lakehouse March 14, 9 AM PDT / 4 PM GMT Register Now We are.

115

115

Kentik

MARCH 27, 2023

Worldwide telecommunications began somewhere around 150 years ago, in 1850, with the first commercial international submarine cable between England and France. A few years later, by 1858, the first trans-Atlantic telegraph cable connected London with North America when 143 words were transmitted in about 10 hours. Today, the United States’ financial and military command systems rely on global submarine cables.

Internet 105

Internet Telecommunications Airlines Government 105

DoorDash Engineering

MARCH 21, 2023

While building a feature store to handle the massive growth of our machine-learning (“ML”) platform, we learned that using a mix of different databases can yield significant gains in efficiency and operational simplicity. We saw that using Redis for our online machine-learning storage was not efficient from a maintenance and cost perspective.

Engineering 132

Engineering Cloud 132

TDAN

MARCH 14, 2023

The world is a-buzz with articles about ChatGPT and other Large Learning Models such as Google’s Bard. The tone and tenor of these articles range from blind hype to abject horror. Some of the hype sounds like a bad paraphrase of Dire Straits: “Look at them losers, that’s the way you do it.

Artificial Intelligence 100

Artificial Intelligence Education 100

InfoQ Articles

MARCH 15, 2023

In this article, I’d like to share our journey at Firefly on a great migration from serverless to Kubernetes jobs, lessons learned, and the technologies that helped us do so with minimal pain.

DevOps 111

DevOps Cloud 111

databricks

MARCH 20, 2023

Large language models (LLMs) are currently in the spotlight following the sensational release of ChatGPT. Many are wondering how to take advantage of.

Engineering 114

Engineering 114

Ben Morris

MARCH 2, 2023

Agile practices on their own are no guarantee of fast flow. You also need a planned architecture that enables team autonomy and supports rapid, iterative delivery.

100

100

DoorDash Engineering

MARCH 7, 2023

While most engineering tooling at DoorDash is focused on making safe incremental improvements to existing systems, in part by testing in production (learn more about our end-to-end testing strategy ), this is not always the best approach when launching an entirely new business line. Building from scratch often requires faster prototyping and customer validation than incremental improvements to an existing system.

Application 119

Application Port Cloud Engineering 119

Kentik

MARCH 7, 2023

So far in this series , I’ve outlined how a scaling enterprise’s accumulation of data (data gravity) struggles against three consistent forces: cost, performance, and reliability. This struggle changes an enterprise; this is “digital transformation,” affecting everything from how business domains are represented in IT to software architectures, development and deployment models, and even personnel structures.

Networking 99

Networking Network Cloud Engineering 99

Dataversity

MARCH 29, 2023

Amid the economic uncertainty that has gripped 2023, IT leaders are scrambling to find ways to reduce costs. Enterprise storage is one of those areas that the IT team can look at for substantial cost savings without sacrificing availability, reliability, cyber resilience, or application performance. Taking a more strategic approach to your enterprise storage infrastructure will […] The post Save Money with Storage-as-a-Service During Uncertain Economic Times appeared first on DATAVERSITY.

Application 98

Application Education 98

InfoQ Articles

MARCH 23, 2023

CI/CD pipelines are a vital addition to any workflow but they can be further improved by the selective addition of observability. This article covers what data to monitor, which metrics to track, and how to best visualize the collected data.

DevOps 105

DevOps 105

databricks

MARCH 29, 2023

Today, we are excited to announce that users can now run SQL queries on Databricks from within Visual Studio Code via a preview.

107

107

TDAN

MARCH 14, 2023

As data programs accelerate their capabilities to tap into insights, the rights of the consumer and their privacy are racing counter. We’ve long had to contend with the balance of how to best use data throughout its lifecycle and build processes. The more recent innovation? The ability to rapidly pivot, experiment, and learn.

Government 97

Government Education 97

Confluent

MARCH 23, 2023

Stream processors work best in just one programming language. Here’s one way languages can communicate efficiently, removing the trade-off between power and comfort.

69

69

Kentik

MARCH 13, 2023

For most enterprise NetOps teams, a discussion about the WAN is a discussion about the cloud. Whether it’s as simple as ensuring solid connectivity with a SaaS provider or designing a robust, secure, hybrid, and multi-cloud architecture, the enterprise wide area network is all about connecting us to our resources, wherever they are. How it used to be When I started my career in networking, servers were down the hall or in the campus data center.

WAN 98

WAN Wide Area Network Topology Internet 98

Dataversity

MARCH 13, 2023

Companies are spending a lot of money on data and analytics capabilities, creating more and more data products for people inside and outside the company. These products rely on a tangle of data pipelines, each a choreography of software executions transporting data from one place to another. As these pipelines become more complex, it’s important […] The post Data Observability vs.

Government 98

Government Education 98

InfoQ Articles

MARCH 20, 2023

Several features have been added to Minimal APIs with the.NET 7 release. This tutorial shows how they are now almost as powerful as traditional controller-based APIs while being far less verbose.

98

98

databricks

MARCH 16, 2023

The demand for data, analytics, and AI talent continues to grow as organizations in every industry adopt new technologies to become more efficient.

101

101

Mixpanel

MARCH 27, 2023

Early this year, we embarked on a mission to remove friction in the B2B SaaS customer buying experience by making all of our plans available online and our pricing transparent. You can now purchase Mixpanel in the same add-to-cart way as almost anything else you shop for online. Today, we’re going one step further and addressing another pain point for customers: the tedious process of negotiating legal terms and conditions, or terms of use.

B2B 59

B2B 59

Confluent

MARCH 16, 2023

Big data was a core term for any company doing data engineering and analytics. Learn how big data has changed and evolved, leading to the fundamental cloud services of today.

Engineering 64

Engineering Cloud 64

Kentik

MARCH 9, 2023

For cloud network specialists, the landscape for their observability efforts includes a mix of physical and virtual networking devices. These devices generate signals (by design or through instrumentation) that provide critical information to those responsible for managing network health. In this article, I will provide some background on different types of telemetry, discuss key network performance signals, and highlight ways network specialists can leverage this device telemetry in their netwo

Networking 97

Networking Network Bandwidth IoT 97

Dataversity

MARCH 15, 2023

As Benjamin Franklin once said, “Nothing is certain except death and taxes.” Add this 21st-century irrefutable fact: The world can’t live without data. With its numbers, characters, facts, and statistics – the operations performed, stored, and analyzed – data has become an irreplaceable facet of daily life. We use data to identify strengths and weaknesses.

Artificial Intelligence 98

Artificial Intelligence Education 98

InfoQ Articles

MARCH 14, 2023

Istio's new ambient mesh allows for a sidecar-less data plane. This article discusses the advantages of that approach and the work that went into making it a reality.

DevOps 93

DevOps Cloud 93

databricks

MARCH 6, 2023

Today, we are excited to announce the public preview of the Databricks SQL Statement Execution API, available on AWS and Azure. You can.

98

98

TDAN

MARCH 14, 2023

A successful data governance program can reap tremendous benefits for an organization, including: 1) trusted, timely, secure, and easily available data for authorized users, 2) data-driven decision making, 3) being nimble to ever-changing regulatory landscape, 4) future-focused business insights, innovation, data monetization and 5) competitive advantage, cost savings, and credibility.

Government 59

Government Education 59

Confluent

MARCH 30, 2023

Why do data teams need data contracts whereas APIs suffice for everyone else? The most important is to get your data systems, as well as your software and data teams aligned.

59

59

Kentik

MARCH 29, 2023

The truth is, designing a network that can withstand the test of time, traffic, and potential disasters is a challenging feat. That’s where network resiliency and redundancy come into play, helping network planners construct robust and efficient networks. But do we always need 100% redundancy to achieve resilience? Let’s find out. Resiliency and redundancy in networking First things first, let’s define resiliency and redundancy in the context of networking.

Networking 97

Networking Network Protocol Gateway 97

Dataversity

MARCH 2, 2023

DevOps teams and site reliability engineers (SREs) deal with code daily. Doing so teaches them to scrutinize their world, make astute observations, and draw unexpected connections. After all, although highly logical and mathematical in nature, software development is, at least in part, art form. Unconvinced by that statement? Consider the parallels between history’s most remarkable […] The post What Architecture Can Teach Us About Self-Healing Systems appeared first on DATAVERSITY.

DevOps 98

DevOps Engineering Artificial Intelligence Education 98

InfoQ Articles

MARCH 24, 2023

Chronicle Wire offers an alternative way of transferring data between systems, delivering more messages, faster, than common JSON/XML approaches. This approach to data serialization improves both latency and throughput.

TCP 91

TCP 91

databricks

MARCH 21, 2023

We are thrilled to announce that Databricks Unity Catalog is now generally available on Google Cloud Platform (GCP). Unity Catalog provides a unified.

Cloud 97

Cloud 97

Packet Pushers

MARCH 31, 2023

Lots of folks suffer from impostor syndrome. Tech is complex--how could you know what youre doing? And yet, many of us are responsible for incredibly complex IT systems. Fake it til you make it, right? To handle the cognitive dissonance of impostor syndrome, we overcompensate. In doing so, we pay a personal price. Today's Heavy Networking guest is Matt Vitale.

Networking 52

Networking Network 52

Confluent

MARCH 29, 2023

Trusted healthcare puts Confluent at the heart of their organization to access data in real time to enable discovery of new insights and meet the needs of patients

Healthcare 59

Healthcare 59

Kentik

MARCH 15, 2023

As networks become distributed and virtualized, the points at which they can be made vulnerable, or their threat surface , expands dramatically. Multi- and hybrid cloud infrastructures add further complexity to securing threat surfaces, adding even more variability to permissions, configuration points for human error to enter the scene, and network boundaries to exploit.

Networking 94

Networking Network Protocol IP Address 94