Jane Street

SEPTEMBER 12, 2023

We’re once again at the end of our internship season, and it’s my taskto provide a few highlights of what the dev interns accomplished whilethey were here.

143

143

Engineering at Meta

SEPTEMBER 7, 2023

Earlier this year, a small team of engineers at Meta started working on an idea for a new app. It would have all the features people expect from a text-based conversations app, but with one very key, distinctive goal – being an app that would allow people to share their content across multiple platforms. We wanted to build a decentralized (or federated) app that would enable people to post content that is viewable by anyone on other social apps, and vice versa.

Email 143

Email Engineering Media Protocol 143

databricks

SEPTEMBER 12, 2023

Chatbots are the most widely adopted use case for leveraging the powerful chat and reasoning capabilities of large language models (LLM). The retrieval.

Application 142

Application Engineering 142

InfoQ Articles

SEPTEMBER 15, 2023

Domain-Driven Cloud (DDC) is an approach for creating your organization’s cloud architecture based on your business model. Based on Domain-Driven Design (DDD) and the architecture principle of high cohesion and low coupling, this article introduces DDC including the technical and human benefits of aligning your cloud architecture to the bounded contexts in your business model.

Cloud 137

Cloud 137

Dataversity

SEPTEMBER 13, 2023

Cloud computing has enabled many organizations to improve the scalability and flexibility of a variety of crucial business functions. As migration to cloud-based solutions gains momentum, understanding the total cost of cloud adoption is crucial. Cloud economics, in particular, is a framework that has been tailored to evaluate and enhance the financial dimensions of harnessing […] The post How Cloud Economics Help Businesses Build Cyber Resilience in the Cloud appeared first on DATAVERSITY

Cloud 130

Cloud Financial Education 130

TDAN

SEPTEMBER 5, 2023

Harnessing the power of data has become critical in today’s digital age when information is abundant and decision-making is critical in many aspects of business. Understanding your data may unearth hidden insights and move your business ahead, whether you’re a small startup or an established enterprise.

Government 128

Government Education 128

Mixpanel

SEPTEMBER 21, 2023

They say write what you know. Why wouldn’t the same go for building apps? Kevin Xu is an engineer-turned-product manager with experience at big tech companies like Google and Stripe. But if you happen to be a “very online” retail stock trader, you may know him as Sir Jack , one of the WallStreetBets community’s more notorious and successful meme stock investors.

Media 116

Media Financial Network Networking 116

databricks

SEPTEMBER 28, 2023

We are excited to announce public preview of GPU and LLM optimization support for Databricks Model Serving! With this launch, you can deploy.

Engineering 124

Engineering 124

InfoQ Articles

SEPTEMBER 21, 2023

There's a worrying trend towards focusing on specialisms at the expense of collaboration, shared responsibility and valuable outcomes, which can take teams away from multi-disciplinary collaboration. This article calls out three collaboration anti-patterns that appeared in more than one organisation, some of the symptoms they cause and some thoughts on how to go about counteracting them.

124

124

Dataversity

SEPTEMBER 11, 2023

Hello! I’m Mark Horseman and welcome to The Cool Kids Corner. This is my monthly check-in to share with you the people and ideas I encounter as a data evangelist with DATAVERSITY. (Read last month’s column here.) This month, we’re talking about the interplay between Data Governance and artificial intelligence (AI). What do we need […] The post The Cool Kids Corner: The Interplay Between Data Governance and AI appeared first on DATAVERSITY.

Government 119

Government Artificial Intelligence Education 119

Confluent

SEPTEMBER 7, 2023

Kafka-on-Windows tutorials are everywhere, but most run Kafka directly on Windows.

116

116

Ben Morris

SEPTEMBER 2, 2023

How should you go about building an architecture practice in organisations where people are allowed to say no? Ultimately, this becomes an exercise in persuasion, pragmatism, and patience.

100

100

Engineering at Meta

SEPTEMBER 7, 2023

We’re introducing Arcadia, Meta’s unified system that simulates the compute, memory, and network performance of AI training clusters. Extracting maximum performance from an AI cluster and increasing overall efficiency warrants a multi-input system that accounts for various hardware and software parameters across compute, storage, and network collectively.

Topology 112

Topology Networking Network Application 112

databricks

SEPTEMBER 14, 2023

As part of MLflow 2’s support for LLMOps, we are excited to introduce the latest updates to support prompt engineering in MLflow 2.7. A.

Engineering 114

Engineering 114

InfoQ Articles

SEPTEMBER 15, 2023

Over the last 30 years, the world has become connected and digital. Open source is how we do modern software development, stitching together downloaded open-source libraries, frameworks, and other code to create new applications or functionality. This is why every developer and senior staff+ roles need to know what open source is and how it works.

Engineering 110

Engineering Application 110

Dataversity

SEPTEMBER 5, 2023

Landing a Data Science role is one thing, but joining an organization where you can truly thrive is quite another. As a Data Science talent strategy leader, I can share my perspective on what I believe solid organizations will have in place to foster an engaged and developing data science community. To anyone navigating today’s Data […] The post Finding the Right Data Science Role: 4 Key Criteria appeared first on DATAVERSITY.

Education 115

Education 115

Confluent

SEPTEMBER 5, 2023

Want to run Kafka on AWS? Our full tutorial provides expert recommendations on how to deploy, monitor, and manage Kafka clusters on AWS.

98

98

DoorDash Engineering

SEPTEMBER 19, 2023

As a tech company, it’s our products and platform – and the engineers that build them – that power what DoorDash is able to offer our Consumers, Dashers, and Merchants every day. We thrive on tackling challenging technical problems and creating opportunities for customers, and take a lot of pride in what we do (and, as regular readers know, periodically share details about our work on this blog).

Engineering 89

Engineering Banking Application 89

Engineering at Meta

SEPTEMBER 7, 2023

Meta presents Chakra execution traces , an open graph-based representation of AI/ML workload execution, laying the foundation for benchmarking and network performance optimization. Chakra execution traces represent key operations, such as compute, memory, and communication, data and control dependencies, timing, and resource constraints. In collaboration with MLCommons , we are seeking industry-wide adoption for benchmarking.

Networking 109

Networking Network Topology Bandwidth 109

databricks

SEPTEMBER 20, 2023

This blog post is in collaboration with Greg Rokita, AVP of Technology at Edmunds. Long envisioned as a key milestone in computing, we've.

112

112

InfoQ Articles

SEPTEMBER 6, 2023

In this annual report, the InfoQ editors discuss the current state of AI, ML, and data engineering and what emerging trends you as a software engineer, architect, or data scientist should watch. We curate our discussions into a technology adoption curve with supporting commentary to help you understand how things are evolving.

Engineering 104

Engineering Artificial Intelligence 104

Dataversity

SEPTEMBER 6, 2023

Generative AI (GenAI) is all the rage in the world today, thanks to the advent of tools like ChatGPT and DALL-E. To their credit, these innovations are extraordinary. They’ve put the power of artificial intelligence and machine learning (AI/ML) into the hands of everyday users. However, these tools have also skewed our perceptions of what […] The post Is Your Data Ready for Generative AI?

Artificial Intelligence 115

Artificial Intelligence Engineering Education 115

TDAN

SEPTEMBER 19, 2023

Information technology (IT) plays a vital role in data governance by implementing and maintaining strategies to manage, protect, and responsibly utilize data. Through advanced technologies and tools, IT ensures that data is securely stored, backed up, and accessible to authorized personnel.

Government 81

Government Information Technology Digital Transformation Education 81

DoorDash Engineering

SEPTEMBER 19, 2023

As an Engineering org, we are tremendously proud of our accomplishments throughout the history of DoorDash, particularly in recent years as we’ve grown and scaled in service of our customers. This success has been heavily influenced by the strength and leadership of our Eng management team; great companies are built by great people who have great managers.

Engineering 81

Engineering 81

Engineering at Meta

SEPTEMBER 5, 2023

Ever wonder what it’s like to write code at Meta’s scale? On the latest episode of the Meta Tech Podcast , Meta engineer Pascal Hartig ( @passy ) sits down with Dustin Shahidehpour and Katherine Zak, two software engineers at Meta, about their careers and what it’s really like to ship code at Meta. Why does Meta have a monorepo?

Engineering 84

Engineering 84

databricks

SEPTEMBER 18, 2023

We are thrilled to introduce the support of a new SQL feature in Apache Spark and Databricks: Lateral Column Alias (LCA). This feature.

Engineering 105

Engineering 105

InfoQ Articles

SEPTEMBER 1, 2023

There’s an increasing concern about the energy use and corresponding carbon emissions of generative AI models. And while the concerns may be overhyped, they still require attention, especially as generative AI becomes integrated into our modern life. Factors such as model architecture, transparency and quantization of models are required to decrease carbon emission from AI systems.

Energy 100

Energy Engineering 100

Dataversity

SEPTEMBER 29, 2023

On a typical day, managers spend 37% of their time making decisions, according to a McKinsey study. Decisions are the lifeblood of a business and need to be made with accuracy and speed. The manual and complex process of decision-making today amounts to 530,000 days of lost productivity and roughly $250 million in labor costs for the […] The post Transforming Decision-Making Processes appeared first on DATAVERSITY.

Education 113

Education 113

Confluent

SEPTEMBER 29, 2023

Use Confluent connectors, stream governance and stream processing and artificial intelligence (AI) to block spammers, reduce network load, and improve your customers' experiences in real time.

Artificial Intelligence 78

Artificial Intelligence Government Networking Network 78

TDAN

SEPTEMBER 19, 2023

Am I right that you can’t open LinkedIn, read a tech or business blog, or attend a conference for more than 30 seconds without encountering the generative AI hype? It’s been this way ever since last fall when OpenAI unleashed ChatGPT upon a (mostly) unsuspecting world.

Government 59

Government Education 59

Packet Pushers

SEPTEMBER 29, 2023

Todays Heavy Networking, sponsored by Palo Alto Networks, discusses Zero Trust Network Access (ZTNA) across the Secure Access Service Edge (SASE). You could think of ZTNA, as VPN evolved and SASE as SD-WAN evolved. Not only do you get an overlay connectivity fabric, but you also get cloud-hosted security services. We talk about how it all works together, the role of client software, Palo Alto Networks' architecture, integrating an IDP, and more.

SASE 52

SASE Networking Network VPN 52

databricks

SEPTEMBER 27, 2023

This blog is authored by Ben Dias, Director of Data Science and Analytics and Ioannis Mesionis, Lead Data Scientist at easyJet Introduction to.

105

105

InfoQ Articles

SEPTEMBER 8, 2023

KafkaFlow, a.NET open-source project, simplifies Kafka-based event-driven app development with features like middleware for message processing, enhancing maintainability, customization potential, and allowing developers to prioritize business logic.

Application 99

Application Engineering 99

Dataversity

SEPTEMBER 18, 2023

As some of you already know, I am dedicating these summer days to the writing of my new book, “99 Questions About Data Management,” which follows in some way the book “20 Things You Have to Know About Data Management.” After the many questions I have received, I find it interesting to answer this one: […] The post Data Marketplace, Data Catalog, and Data Sharing Agreements: Let’s Make It Clear appeared first on DATAVERSITY.

Government 111

Government Education 111

Confluent

SEPTEMBER 12, 2023

Startups using data streaming can submit an application to win an investment from Confluent.

Application 78

Application 78

TDAN

SEPTEMBER 19, 2023

The catapulting of data to become a new class of business assets and the rapid evolution of generative and non-generative AI requires the integration of data and law for success in today’s business environment.

Government 59

Government Education 59

Akins IT

SEPTEMBER 29, 2023

The city of Los Angeles has long been a hub for innovation and commerce. However, in the digital age, the city's businesses have become targets for increasingly sophisticated cyber attacks. In this blog post, we'll examine a few of the instances where recent cyber attacks have severely impacted LA businesses, shedding light on the challenges they faced and the lessons we can glean from these real-world scenarios.

Financial 52

Financial Banking Encryption Network 52