Sat.Sep 16, 2023 - Fri.Sep 22, 2023

article thumbnail

Article: Bridging Silos and Overcoming Collaboration Antipatterns in Multidisciplinary Organisations

InfoQ Articles

There's a worrying trend towards focusing on specialisms at the expense of collaboration, shared responsibility and valuable outcomes, which can take teams away from multi-disciplinary collaboration. This article calls out three collaboration anti-patterns that appeared in more than one organisation, some of the symptoms they cause and some thoughts on how to go about counteracting them.

137
137
article thumbnail

How Edmunds builds a blueprint for generative AI

databricks

This blog post is in collaboration with Greg Rokita, AVP of Technology at Edmunds. Long envisioned as a key milestone in computing, we've.

128
128
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

He helped shape WallStreetBets. Now Kevin Xu is betting on his own social app.

Mixpanel

They say write what you know. Why wouldn’t the same go for building apps? Kevin Xu is an engineer-turned-product manager with experience at big tech companies like Google and Stripe. But if you happen to be a “very online” retail stock trader, you may know him as Sir Jack , one of the WallStreetBets community’s more notorious and successful meme stock investors.

Media 116
article thumbnail

Data Marketplace, Data Catalog, and Data Sharing Agreements: Let’s Make It Clear

Dataversity

As some of you already know, I am dedicating these summer days to the writing of my new book, “99 Questions About Data Management,” which follows in some way the book “20 Things You Have to Know About Data Management.” After the many questions I have received, I find it interesting to answer this one: […] The post Data Marketplace, Data Catalog, and Data Sharing Agreements: Let’s Make It Clear appeared first on DATAVERSITY.

article thumbnail

How to Achieve High-Accuracy Results When Using LLMs

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

article thumbnail

How DoorDash Fosters Meaningful Engineering Career Development

DoorDash Engineering

As a tech company, it’s our products and platform – and the engineers that build them – that power what DoorDash is able to offer our Consumers, Dashers, and Merchants every day. We thrive on tackling challenging technical problems and creating opportunities for customers, and take a lot of pride in what we do (and, as regular readers know, periodically share details about our work on this blog).

article thumbnail

A Costa Rica journey with a Twist of Pura Vida

databricks

Costa Rica is known for several things, both culturally and ecologically. Among those are biodiversity, coffee, Pura Vida, and most recently a rapidly.

126
126

More Trending

article thumbnail

What Is Metaflow? Quick Tutorial and Overview

Dataversity

As data science continues to evolve, new tools and technologies are being developed to help individuals and organizations streamline their workflows, improve efficiency, and drive better results. One of the most powerful and innovative tools in this space is Metaflow, a Python library that makes it easy to build and manage data science workflows. In […] The post What Is Metaflow?

Cloud 78
article thumbnail

How DoorDash Defines Great Engineering Management

DoorDash Engineering

As an Engineering org, we are tremendously proud of our accomplishments throughout the history of DoorDash, particularly in recent years as we’ve grown and scaled in service of our customers. This success has been heavily influenced by the strength and leadership of our Eng management team; great companies are built by great people who have great managers.

article thumbnail

Introducing the Support of Lateral Column Alias

databricks

We are thrilled to introduce the support of a new SQL feature in Apache Spark and Databricks: Lateral Column Alias (LCA). This feature.

article thumbnail

AI and Data Streaming: Essential Resources for Developers

Confluent

Explore the intersection of AI and data streaming with essential resources for developers. Discover recorded talks, blog posts, and upcoming events to boost your knowledge.

72
article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

article thumbnail

Strategies for Tackling Digital Transformation Resistance

Dataversity

The often-overused phrase “digital transformation” instills a sense of excitement and progress for many executives. But for some business leaders, digital transformation means intimidation or mystery. When the former group is tasked with selling data-driven technology initiatives to the latter group, they face formidable challenges. They must win hearts and minds to get buy-in, sometimes faced with […] The post Strategies for Tackling Digital Transformation Resistance appeared first on DAT

article thumbnail

Through the Looking Glass: Data Provenance in the Age of Generative AI

TDAN

Am I right that you can’t open LinkedIn, read a tech or business blog, or attend a conference for more than 30 seconds without encountering the generative AI hype? It’s been this way ever since last fall when OpenAI unleashed ChatGPT upon a (mostly) unsuspecting world.

article thumbnail

Orchestrating Data Analytics with Databricks Workflows

databricks

For data-driven enterprises, data analysts play a crucial role in extracting insights from data and presenting it in a meaningful way. However, many.

119
119
article thumbnail

Apache Kafka Message Compression

Confluent

Learn how Apache Kafka message compression works, why and how to use it, the five types of compression, configurations for the compression type, and how messages are decompressed.

72
article thumbnail

Launching LLM-Based Products: From Concept to Cash in 90 Days

Speaker: Christophe Louvion, Chief Product & Technology Officer of NRC Health and Tony Karrer, CTO at Aggregage

Christophe Louvion, Chief Product & Technology Officer of NRC Health, is here to take us through how he guided his company's recent experience of getting from concept to launch and sales of products within 90 days. In this exclusive webinar, Christophe will cover key aspects of his journey, including: LLM Development & Quick Wins 🤖 Understand how LLMs differ from traditional software, identifying opportunities for rapid development and deployment.

article thumbnail

Data Governance in the Age of Generative AI

Dataversity

AI-based business models and products that use generative AI (GenAI) are proliferating across a wide range of industries. The current wave of AI is creating new ways of working, and research suggests that business leaders feel optimistic about the potential for measurable productivity and customer service improvements, as well as transformations in the way that […] The post Data Governance in the Age of Generative AI appeared first on DATAVERSITY.

article thumbnail

Legal Issues for Data Professionals

TDAN

The catapulting of data to become a new class of business assets and the rapid evolution of generative and non-generative AI requires the integration of data and law for success in today’s business environment.

article thumbnail

Unexpected Tools in the Databricks Marketplace to Supercharge Manufacturing Supply Chains

databricks

“Supply chains compete, not companies” — Martin Christopher No two supply chains are identical - the unique combination of products, industries, and geographic locat.

115
115
article thumbnail

US Foods Builds Digital-First Ecommerce Platform with Data Streaming

Confluent

Learn how US Foods built a digital-first ecommerce platform—using data streaming to future-proof its infrastructure and implement data mesh principles.

69
article thumbnail

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI pr

article thumbnail

Seamless Data Exchange: Best Practices for Modern Businesses

Dataversity

In today’s dynamic business landscape, the ability to share, receive, and process information swiftly has become a critical success factor. The rapid pace of digital transformation has amplified the demand for efficient and seamless data exchange mechanisms that allow businesses to remain agile, make informed decisions, and maintain a competitive edge.

article thumbnail

Heavy Networking 702: Supporting Network Automation With The Pandas Python Library

Packet Pushers

Today's Heavy Networking covers Pandas. Not the cuddly bears that eat bamboo, but the Python library that makes it easy for you to work with a set of data. Import Pandas at the top of your Python script, follow one of many Pandas tutorials online, and in short order youll be able to perform data operations in a spreadsheet-like way. We talk network automation use cases for Pandas with Rick Donato.

article thumbnail

Apache Spark 3 Apache DataSketches: New Sketch-Based Approximate Distinct Counting

databricks

Introduction In this blog post, we'll explore a set of advanced SQL functions available within Apache Spark that leverage the HyperLogLog algorithm, enabling.

article thumbnail

Top 5 Best Practices for Building Event-Driven Architectures Using Confluent and AWS Lambda

Confluent

Discover the top 5 best practices for building event-driven architectures using Confluent and AWS Lambda. Learn how to optimize your architecture for scalability, reliability, and performance.

69
article thumbnail

Reimagined: Building Products with Generative AI

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

article thumbnail

The Power of Graph Databases to Detect Fraud

Dataversity

Graph databases play a key role in fraud detection within intricate, complex networks, helping security teams keep pace with modern fraud techniques that are becoming increasingly more sophisticated. Graph databases can identify patterns and relationships in big data, reducing the level of complexity so that detection algorithms can effectively discover fraud attempts within a network. […] The post The Power of Graph Databases to Detect Fraud appeared first on DATAVERSITY.

Network 64
article thumbnail

IPv6 Buzz 135: Making Sense Of IPv6 Address Formatting

Packet Pushers

Today's IPv6 Buzz episode dives into the topic of IPv6 address formatting, the do's and don'ts of representing an IPv6 address, and what guidance RFC 5952 provides for representing these very long addresses in text. Today's IPv6 Buzz episode dives into the topic of IPv6 address formatting, the do's and don'ts of representing an IPv6 address, and what guidance RFC 5952 provides for representing these very long addresses in text.

52
article thumbnail

Congratulations to Summer Hacakthon Winners!

databricks

Earlier this year, Databricks launched Dolly 2.0: the world's first truly open instruction-tuned Large Language Model (LLM). To build off this excitement around.

105
105
article thumbnail

From Outages to On-Time Delivery: How Confluent Cloud Transformed a Delivery Company's Data Infrastructure

Confluent

Learn how a grocery delivery company guarantees same day delivery with Confluent as the backbone of their data streaming infrastructure.

Cloud 64
article thumbnail

A Tale of Two Case Studies: Using LLMs in Production

Speaker: Tony Karrer, Ryan Barker, Grant Wiles, Zach Asman, & Mark Pace

Join our exclusive webinar with top industry visionaries, where we'll explore the latest innovations in Artificial Intelligence and the incredible potential of LLMs. We'll walk through two compelling case studies that showcase how AI is reimagining industries and revolutionizing the way we interact with technology. Some takeaways include: How to test and evaluate results 📊 Why confidence scoring matters 🔐 How to assess cost and quality 🤖 Cross-platform cost vs. quality tr

article thumbnail

CCPA vs. GDPR: Differences and Similarities for Data Protection

Dataversity

The California Consumer Privacy Act (CCPA) and the General Data Protection Regulation (GDPR) were created to empower individuals with greater control over their personal information. Both laws regulate the activities of organizations that collect and use data in various ways. Data protection plays an essential role in ensuring compliance with both privacy regulations.

article thumbnail

The Cato Journey – Bringing SASE Transformation to the Largest Enterprises  

CATO Networks

One of the observations I sometimes get from analysts, investors, and prospects is that Cato is a mid-market company. They imply that we are creating solutions that are simple and affordable, but dont necessarily meet stringent requirements in scalability, availability, and functionality. Here is the bottom line: Cato is an enterprise software company.

SASE 52
article thumbnail

Solution Accelerator: LLMs for Manufacturing

databricks

Since the publication of the seminal paper on transformers by Vaswani et. al. from Google, large language models (LLMs) have come to dominate.

105
105
article thumbnail

McAfee Moves from Monolith to Microservices on Confluent Cloud

Confluent

Learn how moving from a monolith to event-driven microservices architecture helped McAfee add more scalability and performance,, including rolling out products and features faster, and how Confluent helped.

Cloud 59
article thumbnail

LLMOps for Your Data: Best Practices to Ensure Safety, Quality, and Cost

Speaker: Shreya Rajpal, Co-Founder and CEO at Guardrails AI & Travis Addair, Co-Founder and CTO at Predibase

Large Language Models (LLMs) such as ChatGPT offer unprecedented potential for complex enterprise applications. However, productionizing LLMs comes with a unique set of challenges such as model brittleness, total cost of ownership, data governance and privacy, and the need for consistent, accurate outputs. Putting the right LLMOps process in place today will pay dividends tomorrow, enabling you to leverage the part of AI that constitutes your IP – your data – to build a defensible AI strategy fo