Sat.Apr 22, 2023 - Fri.Apr 28, 2023

article thumbnail

A data architecture pattern to maximize the value of the Lakehouse

databricks

One of Lakehouse's outstanding achievements is the ability to combine workloads for modern use cases, such as traditional BI, machine learning & AI.

119
119
article thumbnail

Article: Agility and Architecture

InfoQ Articles

Software architecture and agility are often portrayed as incompatible. In reality, they are mutually reinforcing - a sound architecture helps teams build better solutions in a series of short intervals, and gradually evolving a system’s architecture helps by validating and improving it over time.

108
108
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

DoorDash identifies Five big areas for using Generative AI

DoorDash Engineering

In the wake of ChatGPT and Generative AI DoorDash is identifying ways this new technology can enhance the customer’s ordering experience on the platform. The company is exploring the use of Generative AI, a subset of Artificial Intelligence that generates novel content based on existing data, and how it can be implemented effectively with consideration for the privacy and security of personal information.

article thumbnail

Cloud Architecture Mistakes: Inadequate Showback and Chargeback Options Escalate Costs

Dataversity

In this five-part series, I’m taking a hard look at the common – and costly – mistakes organizations typically make while building a cloud architecture. Part one explained how organizations can quickly lose visibility and control over their data processing,and detailed how to avoid that mistake. Part two looked at why a DIY approach often […] The post Cloud Architecture Mistakes: Inadequate Showback and Chargeback Options Escalate Costs appeared first on DATAVERSITY.

Cloud 98
article thumbnail

How to Achieve High-Accuracy Results When Using LLMs

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

article thumbnail

Databricks ?? Hugging Face

databricks

Generative AI has been taking the world by storm. As the data and AI company, we have been on this journey with the.

105
105
article thumbnail

Article: Respect. Support. Connect. The Manager’s Role in Building a Great Remote Team

InfoQ Articles

As managers, we face challenges in terms of needs, accessibility, gender, nationalities, and other conditions that influence our teams and working environments. We cannot build projects based on Excel sheets only, not considering peoples’ preferences and options for personal growth. We need to see real people – even if we meet them in a virtual working environment only.

98

More Trending

article thumbnail

Why CIOs Should Invest in Business Automation

Dataversity

In an increasingly challenging economic environment, it’s essential that chief information officers (CIOs) take a thoughtful approach to investing capital. The 2023 Gartner® CIO and Technology Executive Survey found that more than half of digital initiatives lag behind leadership expectations, with 59% reporting the initiatives take too long to complete and 52% reporting the initiatives take too […] The post Why CIOs Should Invest in Business Automation appeared first on DATAVERSITY.

article thumbnail

Announcing the General Availability of Predictive I/O for Reads

databricks

Today, we are excited to announce the general availability of Predictive I/O for Databricks SQL (DB SQL): a machine learning powered feature to.

105
105
article thumbnail

??Kafka Summit London 2023: Level Up Your Kafka Experience!

Confluent

Kafka Summit 2023 brings 60+ sessions, keynotes, and lightning talks, and more from industry leaders. Check out the agenda, highlights, networking events, and more event info.

article thumbnail

Article: How Not to Use the DORA Metrics to Measure DevOps Performance

InfoQ Articles

The DORA metrics are the de facto measuring stick but they can be used incorrectly and drive poor behavior and performance. When using any metrics, a strong focus on the end goal must be maintained.

DevOps 60
article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

article thumbnail

Heavy Networking 676: Implementing ZTNA And SASE With Fortinet (Sponsored)

Packet Pushers

Fortinet is a security vendor most of you have heard of. But if all you think of when you hear the name Fortinet is firewalls, well yeah, but you should think more broadly. On today's sponsored Heavy Networking we're going after the work-from-anywhere challenge with Fortinets Zero Trust Network Access (ZTNA) and Secure Access Service Edge (SASE) tech, all of which is baked into FortiOS.

SASE 52
article thumbnail

Enhancing Product Search with Large Language Models (LLMs)

databricks

The text generation capabilities of ChatGPT, Dolly and the like are truly impressive and are rightfully recognized as major steps forward in the.

105
105
article thumbnail

The (Hidden) Cost of Kafka Operations

Confluent

Quantifying the cost of running Kafka is challenging. In part 2, learn how to calculate Kafka costs stemming from the development and operations personnel needed to self-manage clusters.

64
article thumbnail

The Art of Proactive Network Monitoring: Stay Ahead of the Game

Obkio

Stay ahead with proactive network monitoring! Learn techniques, best practices, and how Obkio detects & resolves issues for seamless user experience.

article thumbnail

Launching LLM-Based Products: From Concept to Cash in 90 Days

Speaker: Christophe Louvion, Chief Product & Technology Officer of NRC Health and Tony Karrer, CTO at Aggregage

Christophe Louvion, Chief Product & Technology Officer of NRC Health, is here to take us through how he guided his company's recent experience of getting from concept to launch and sales of products within 90 days. In this exclusive webinar, Christophe will cover key aspects of his journey, including: LLM Development & Quick Wins 🤖 Understand how LLMs differ from traditional software, identifying opportunities for rapid development and deployment.

article thumbnail

Will My Career Benefit from Becoming a Citizen Data Scientist?

Dataversity

As a team member within a business environment, you may be familiar with the term “citizen data scientist.” This term has been around for some time and was popularized by Gartner, which defines a citizen data scientist as “a person who creates or generates models that leverage predictive or prescriptive analytics, but whose primary job function is outside […] The post Will My Career Benefit from Becoming a Citizen Data Scientist?

article thumbnail

Announcing Public Preview of Databricks Marketplace

databricks

We are excited to announce the public preview of Databricks Marketplace, an open marketplace for all your data, analytics, and AI, powered by.

105
105
article thumbnail

Q&A—How Cloud Services Are Helping NASA Take Kafka Farther, Faster

Confluent

See how cloud services help NASA mission teams stream and publicize petabytes of data, connect a global network of astronomers, and enhance scientific discovery.

Cloud 59
article thumbnail

10 Best Application Performance Monitoring Tools to Keep Your Apps in Top Shape

Obkio

Effective application performance monitoring (APM) requires tailoring your strategy to your specific needs. This article provides considerations and recommendations for choosing the right APM tools and techniques based on multiple factors.

article thumbnail

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI pr

article thumbnail

Elevate Your Decision-Making: The Impact of Observability on Business Success

Dataversity

In our rapidly evolving microservices and digital landscape, keeping track of what is happening with these services and making well-informed decisions is paramount for business success. With observability, organizations can navigate complex challenges and unlock their full potential in the digital world. Observability is a term that was coined for control systems to measure how well a […] The post Elevate Your Decision-Making: The Impact of Observability on Business Success appeared first

article thumbnail

Applying software development & DevOps best practices to Delta Live Table pipelines

databricks

Databricks Delta Live Tables (DLT) radically simplifies the development of the robust data processing pipelines by decreasing the amount of code that data.

DevOps 105
article thumbnail

Delivery Guarantees and the Ethics of Teleportation

Confluent

Explore the various types of message delivery guarantees including at most once, at least once, and exactly once delivery through the example of teleportation.

59
article thumbnail

Day Two Cloud 192: OpenTelemetry – Getting From Visibility To Observability With Ben Hall

Packet Pushers

OpenTelemetry is an open-source project that brings together tools, SDKs, and APIs for collecting telemetry--that is, logs, metrics, and traces in a standardized way. The goal of the project is to help developers and operators instrument highly distributed applications and services to understand dependencies, monitor performance, and quickly troubleshoot problems.

Cloud 52
article thumbnail

Reimagined: Building Products with Generative AI

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

article thumbnail

How to Troubleshoot Slow Network Performance and Win The Great Network Race

Obkio

Get ahead of the pack! Learn how to troubleshoot slow network performance with our step-by-step guide and win the great network race. Start optimizing now!

article thumbnail

Anomaly Detection to Prevent Energy Loss

databricks

Energy loss in the utility space is primarily broken down into two categories: fraud and leakage. Fraud (or energy theft) is malicious and.

Energy 98
article thumbnail

How EVO Banco Is Reinventing Fraud Prevention with Data Streaming

Confluent

Financial fraud prevention is critical for digital-native banks.

Banking 52
article thumbnail

Unlocking Emissions Reduction Performance Through Technology and Data

Dataversity

As businesses come to terms with climate change and its implications, they must develop ways to measure their impact on the climate and the environment. And while business stakeholders want to understand how corporate operations contribute to climate change, they also want assurances that companies have developed plans for climate change adaptation, especially emissions reduction. […] The post Unlocking Emissions Reduction Performance Through Technology and Data appeared first on DATAVERSI

article thumbnail

A Tale of Two Case Studies: Using LLMs in Production

Speaker: Tony Karrer, Ryan Barker, Grant Wiles, Zach Asman, & Mark Pace

Join our exclusive webinar with top industry visionaries, where we'll explore the latest innovations in Artificial Intelligence and the incredible potential of LLMs. We'll walk through two compelling case studies that showcase how AI is reimagining industries and revolutionizing the way we interact with technology. Some takeaways include: How to test and evaluate results 📊 Why confidence scoring matters 🔐 How to assess cost and quality 🤖 Cross-platform cost vs. quality tr

article thumbnail

Network Break 427: Prosimo Launches Cloud-Native Networking Suite; Broadcom Stitches New Jericho ASIC For AI-Friendly Network Fabrics

Packet Pushers

Take a Network Break! This week we cover new cloud networking capabilities from Prosimo, discuss Broadcom's latest version of the Jericho ASIC which is being positioned for network fabrics for AI workloads, and explore the latest version of the open-source Dent network OS. We also cover financial results from F5, Starlink price cuts, and more tech news.

article thumbnail

Improving Public Sector Decision Making With Simple, Automated Record Linking

databricks

What is data linking and why does it matter? Availability of more, high quality data is a critical enabler for better decision making.

97
article thumbnail

Refactoring the Role of Software Architects

UML Zone

This presentation takes you through a journey to explore some software architecture principles, forged through practice from real-world projects. You will learn strategies for mentoring development teams, scaling processes, and maximizing efficiency. With the right structures in place, software architects can guide teams into the pit of success, as Scott Guthrie likes to put it. […] The post Refactoring the Role of Software Architects first appeared on Software Architecture & Design.

52
article thumbnail

Top 11 SaaS Performance Monitoring Tools & Techniques: Unlock the Full Potential of Your Application

Obkio

Discover the top 11 SaaS performance monitoring tools and techniques to optimize your application's speed and stability.

article thumbnail

LLMOps for Your Data: Best Practices to Ensure Safety, Quality, and Cost

Speaker: Shreya Rajpal, Co-Founder and CEO at Guardrails AI & Travis Addair, Co-Founder and CTO at Predibase

Large Language Models (LLMs) such as ChatGPT offer unprecedented potential for complex enterprise applications. However, productionizing LLMs comes with a unique set of challenges such as model brittleness, total cost of ownership, data governance and privacy, and the need for consistent, accurate outputs. Putting the right LLMOps process in place today will pay dividends tomorrow, enabling you to leverage the part of AI that constitutes your IP – your data – to build a defensible AI strategy fo