article thumbnail

Introducing DoorDash’s In-House Search Engine

DoorDash Engineering

Two primary aspects of that search engine were causing the trouble: its document-replication mechanism and its lack of support for complex document relationships. We decided the best way to address these challenges was to move away from Elasticsearch to a homegrown search engine. latency reduction and a 75% hardware cost decrease.

article thumbnail

LLM Inference Performance Engineering: Best Practices

databricks

In this blog post, the MosaicML engineering team shares best practices for how to capitalize on popular open source large language models (LLMs).

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Article: Virtual Panel: How to Become a Principal Engineer

InfoQ Articles

As a software engineer or individual contributor, the next step in your career can be to become a principal engineer. The path to becoming a principal engineer at companies can feel unclear, which can inhibit individual engineering careers. By Ben Linders, Joy Ebertz, Pablo Fredrikson, Charlotte de Jong Schouwenburg

article thumbnail

AI Lab: The secrets to keeping machine learning engineers moving fast

Engineering at Meta

The key to developer velocity across AI lies in minimizing time to first batch (TTFB) for machine learning (ML) engineers. Time to first batch (TTFB), the delay from when a workflow is submitted to the training job’s first batch, plays an important role in accelerating our machine learning (ML) engineers’ iteration speeds.

article thumbnail

Migrating Python to Rust: Channel Groups Engineering Notes

PubNub

Our Channel Group infrastructure is one example of our engineering challenges. Migrating Python to Rust for scalability and adaptability.

article thumbnail

Article: InfoQ AI, ML and Data Engineering Trends Report - September 2024

InfoQ Articles

InfoQ editorial staff and friends of InfoQ are discussing the current trends in the domain of AI, ML and Data Engineering as part of the process of creating our annual trends report. By Srini Penchikala, Mandy Gu, Namee Oberst, Roland Meertens, Anthony Alford, Daniel Dominguez

article thumbnail

Updates to the Event Engine and Event Listeners

PubNub

We have made updates to our Event Engine and Event Listener architecture to provide PubNub developers with the best possible experience