databricks

NOVEMBER 12, 2024

Monolithic to Modular The proof of concept (POC) of any new technology often starts with large, monolithic units that are difficult to characterize.

Engineering 101

Engineering Application 101

databricks

DECEMBER 6, 2023

Retrieval-Augmented-Generation (RAG) has quickly emerged as a powerful way to incorporate proprietary, real-time data into Large Language Model (LLM) applications. Today we are.

Application 131

Application Engineering 131

Engineering at Meta

JULY 16, 2024

The key to developer velocity across AI lies in minimizing time to first batch (TTFB) for machine learning (ML) engineers. Time to first batch (TTFB), the delay from when a workflow is submitted to the training job’s first batch, plays an important role in accelerating our machine learning (ML) engineers’ iteration speeds.

Engineering 119

Engineering Application 119

Docker Blog

JANUARY 8, 2025

We will walk through creating a Docker container for your Django application. Why containerize your Django application? WORKDIR : Sets the working directory of the application within the container. This change reduces the size of the image considerably, as the image now only contains what is needed to run the application.

Port 295

Port Application Server Government 295

Engineering at Meta

AUGUST 5, 2024

Each benchmark within DCPerf is designed by referencing a large application within Meta’s production server fleet. DCPerf provides a much richer set of application software diversity and helps get better coverage signals on platform performance versus existing benchmarks such as SPEC CPU.

Application 104

Application Data Centers Server Internet 104

ByteByteGo

DECEMBER 19, 2024

The sidecar pattern is one such design pattern that has gained prominence in modern software engineering. At its core, the sidecar pattern pairs a secondary process or service (the "sidecar") with a primary application to handle complementary tasks.

Application 219

Application Engineering 219

Engineering at Meta

NOVEMBER 15, 2023

The 2023 edition of Networking at Scale focused on how Meta’s engineers and researchers have been designing and operating the network infrastructure over the last several years for Meta’s AI workloads, including our numerous ranking and recommendation workloads and the immense GenAI models.

Engineering 103

Engineering Network Networking Topology 103

DoorDash Engineering

MARCH 7, 2023

While most engineering tooling at DoorDash is focused on making safe incremental improvements to existing systems, in part by testing in production (learn more about our end-to-end testing strategy ), this is not always the best approach when launching an entirely new business line. Set up a locally running containerized PostgreSQL database.

Application 119

Application Port Cloud Engineering 119

ByteByteGo

JANUARY 11, 2025

There are multiple strategies that can help: Containerization is one of the first strategies to make application deployments based on code. Docker is one of the most popular ways to containerize the application. Next, container orchestration becomes a necessity when dealing with multiple containers in an application.

IP Address 203

IP Address TCP Server DNS 203

Docker Blog

DECEMBER 18, 2024

This fragmentation slows down innovation and makes it harder for teams to bring AI-driven features into their applications. Whether you’re developing cutting-edge AI/ML applications or just beginning to experiment with AI tools, this integration empowers developers to innovate without distraction. Docker Desktop 4.37

Application 242

Application Engineering Networking Network 242

Mathias Verraes

JANUARY 8, 2025

Finding good objects means identifying abstractions that are part of your applications domain and its execution machinery. Even when modeling domain concepts, you need to look carefully at how those objects fit into your overall application design. The alarm sounds, an engineer turns it off, but what happens to the second alarm?

Engineering 235

Engineering Application 235

InfoQ Articles

JULY 2, 2024

In this article, Senior Engineering Manager and AWS Serverless Hero Sheen Brisals examines how the characteristics of serverless such as optimization, robust availability and scalability influence us to think in a new way of architecting and evolving modern applications as set pieces, a concept from moviemaking.

Application 85

Application Engineering DevOps Cloud 85

Netflix Tech Blog

JANUARY 6, 2025

This article is the last in a multi-part series sharing a breadth of Analytics Engineering work at Netflix, recently presented as part of our annual internal Analytics Engineering conference. When applying this to a dashboard application, the easiest way to use design effectively is to leverage existing patterns.

Engineering 81

Engineering Energy Application 81

Engineering at Meta

MARCH 18, 2024

Systems and application logs play a key role in operations, observability, and debugging workflows at Meta. At a high level, Logarithm comprises the following components: Application processes emit logs using logging APIs. verbosity) in application code. learning rate), model internal state tensors (e.g., Multimodal data (e.g.,

Engineering 105

Engineering Application Bandwidth Network 105

DoorDash Engineering

SEPTEMBER 19, 2023

As a tech company, it’s our products and platform – and the engineers that build them – that power what DoorDash is able to offer our Consumers, Dashers, and Merchants every day. It’s for this reason that in Q2 2023, we revisited our performance expectations for all engineers at DoorDash.

Engineering 89

Engineering Banking Application 89

Engineering at Meta

JANUARY 29, 2024

Slow build times and inefficiencies in packaging and distributing execution files were costing our ML/AI engineers a significant amount of time while working on our training stack. We plan to enable all our ML engineers to operate on the same revision, which will improve the cache hit ratios of our build.

Application 97

Application Engineering Bandwidth Data Centers 97

InfoQ Articles

SEPTEMBER 17, 2024

In the InfoQ "Practical Applications of Generative AI" article series, we present real-world solutions and hands-on practices from leading GenAI practitioners. Generative AI (GenAI) has become a major component of the artificial intelligence (AI) and machine learning (ML) industry. However, using GenAI comes with challenges and risks.

Artificial Intelligence 93

Artificial Intelligence Application Engineering 93

Docker Blog

JANUARY 16, 2025

Downtime halts innovation as fines for compliance failures and engineering efforts re-route to forensic security analysis. This combination of tools enables your engineering team to put out fires and, more importantly, prevent them from starting in the first place. A breach is more than a line item in the budget.

Government 270

Government Application Engineering 270

DoorDash Engineering

AUGUST 13, 2024

Our engineers — the primary users of this platform — manage Kafka-related resources such as topics, users, and access control lists, or ACLs, through Terraform. Kafka Self-Serve empowers product engineers to onboard and manage their Kafka resources with minimal interaction from infrastructure engineers.

Engineering 82

Engineering Application 82

databricks

SEPTEMBER 12, 2023

Chatbots are the most widely adopted use case for leveraging the powerful chat and reasoning capabilities of large language models (LLM). The retrieval.

Application 142

Application Engineering 142

ByteByteGo

JANUARY 28, 2025

The zero flakes guarantee cuts out false alarms and wasted engineering hours. Schedule a demo to learn more Disclaimer: The details in this post have been derived from multiple AWS reInvent talks and articles by the Amazon engineering team. Unlimited parallel test runs validate every change in minutes, not days.

Virtual machine 147

Virtual machine Application Engineering Server 147

Engineering at Meta

DECEMBER 2, 2024

Unlocking advertiser value through industry-leading ML innovation Meta Andromeda is a personalized ads retrieval engine that leverages the NVIDIA Grace Hopper Superchip, to enable cutting edge ML innovation in the Ads retrieval stage to drive efficiency and advertiser performance.

Engineering 92

Engineering Advertising Bandwidth Network 92

Confluent

SEPTEMBER 24, 2020

Operating critical Apache Kafka® event streaming applications in production requires sound automation and engineering practices. Streaming applications are often at the center of your transaction processing and data systems, requiring […].

DevOps 143

DevOps Application Engineering 143

InfoQ Articles

APRIL 2, 2024

In this article, author Ashley Davis discusses how to add a natural language interface to a chatbot application using OpenAI REST API. He also shows how to extend the chatbot by adding voice commands using MediaRecorder API and OpenAI's speech transcription API. By Ashley Davis

Application 84

Application Artificial Intelligence Engineering 84

databricks

DECEMBER 13, 2023

Background In an era where Retrieval-Augmented Generation (RAG) is revolutionizing the way we interact with AI-driven applications, ensuring the efficiency and effectiveness of.

Application 101

Application Engineering 101

NW Kings

JANUARY 9, 2025

Among the most sought-after roles are Network Engineers and Cloud Engineers. What Are the Roles of Cloud Engineers and Network Engineers? Cloud Engineer A Cloud Engineer specializes in cloud computing technologies. Key responsibilities include: Deploying applications in the cloud.

Engineering 52

Engineering Cloud Network Networking 52

InfoQ Articles

JANUARY 24, 2022

Successfully correlating monitoring and observability data to arrive allows engineers to arrive at the root cause more rapidly. Change Intelligence is often a missing component in incident management.

Application 101

Application Engineering DevOps 101

ByteByteGo

DECEMBER 7, 2024

Redpanda Streamfest: Learn the latest in streaming data and AI (Sponsored) Redpanda Streamfest is your best chance to learn the latest techniques and technologies for building data pipelines that support real-time applications, analytics and AI. Used in IPTV and video conference applications. The solution?

Unicast 211

Unicast Banking Protocol Network 211

InfoQ Articles

SEPTEMBER 15, 2023

Open source is how we do modern software development, stitching together downloaded open-source libraries, frameworks, and other code to create new applications or functionality. Over the last 30 years, the world has become connected and digital. By Nithya Ruff

Engineering 110

Engineering Application 110

NW Kings

JANUARY 25, 2025

In today’s digital landscape, mastering Python for Network Engineers is essential for automating tasks and improving efficiency. It enables engineers to write scripts that can interact with network devices, manipulate data, and implement complex automation tasks. The result is printed to the console for easy viewing.

Engineering 52

Engineering Network Networking IP Address 52

ByteByteGo

JANUARY 25, 2025

The zero flakes guarantee cuts out false alarms and wasted engineering hours. Youtube video) The Ultimate API Learning Roadmap 30 Useful AI Apps That Can Help You in 2025 10 Essential Components of a Production Web Application How do we design effective and safe APIs? Code First v.s. API First Oauth 2.0

Cookie 173

Cookie Gateway Server Application 173

Netflix Tech Blog

JANUARY 2, 2025

This article is the second in a multi-part series sharing a breadth of Analytics Engineering work at Netflix, recently presented as part of our annual internal Analytics Engineering conference. Need to catch up? Check out Part 1.

Engineering 76

Engineering Application 76

InfoQ Articles

JANUARY 3, 2025

Committed to transforming engineering mindsets for efficient application development in a rapidly evolving tech landscape. Advocates for optimized, functionless architecture to reduce complexity and costs. Expertise in leveraging cloud-native services for sustainable operations and minimizing code liabilities. By Sheen Brisals

Cloud 112

Cloud Engineering Application DevOps 112

Cloudera Blog

OCTOBER 8, 2024

Enterprise developers began exploring proof of concepts (POCs) for generative AI applications, leveraging API services and open models such as Llama 2 and Mistral. Businesses are now allocating dedicated budgets and building infrastructure to support AI applications in real-world environments.

Application 75

Application Government Protocol Cloud 75

Confluent

NOVEMBER 3, 2021

SQL has proven to be an invaluable asset for most software engineers building software applications. Yet, the world as we know it has changed dramatically since SQL was created in […].

Engineering 132

Engineering Application 132

Confluent

JANUARY 29, 2021

What happens when you let engineers go wild building an application to track the score of a table football game? This blog post shares SPOUD’s story of engineering a simple […].

Engineering 118

Engineering Application 118

Confluent

AUGUST 6, 2021

It is often difficult enough to build one application that talks to a single middleware or backend layer; e.g., a whole team of frontend engineers may build a web application […].

Application 119

Application Engineering 119