Sat.Oct 21, 2023 - Fri.Oct 27, 2023

article thumbnail

Introducing Predictive Optimization: Faster Queries, Cheaper Storage, No Sweat

databricks

Predictive Optimization intelligently optimizes your Lakehouse table data layouts for peak performance and cost-efficiency - without you needing to lift a finger.

133
133
article thumbnail

Announcing Apache Flink 1.18

Confluent

Read updates and improvements in Apache Flink 1.18, including dynamic fine-grained rescaling via REST API, Java 17 support, and faster rescaling & batch performance improvements.

125
125
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Automating dead code cleanup

Engineering at Meta

Meta’s Systematic Code and Asset Removal Framework (SCARF) has a subsystem for identifying and removing dead code. SCARF combines static and dynamic analysis of programs to detect dead code from both a business and programming language perspective. SCARF automatically creates change requests that delete the dead code identified from the program analysis, minimizing developer costs.

article thumbnail

Data Masking Best Practices and Benefits

Dataversity

In today’s digital world, data rules. Yet information must remain confidential to have any value in a business context. Customer data, financial records, and intellectual property are susceptible to cyber threats. As a result, reinforcing security is a must for organizations that want to keep their reputation. This is where data masking comes in. What Is […] The post Data Masking Best Practices and Benefits appeared first on DATAVERSITY.

Financial 115
article thumbnail

How to Achieve High-Accuracy Results When Using LLMs

Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage

When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m

article thumbnail

Learn How to Build Airtight Data Pipelines for your AI Initiatives

databricks

"I can't think of anything that's been more powerful since the desktop computer." — Michael Carbin, Associate Professor, MIT, and Founding Advisor, MosaicML A.

119
119
article thumbnail

Article: Has Your Architectural Decision Record Lost Its Purpose?

InfoQ Articles

Architectural Decision Records (ADRs) are important vehicles for communicating the architectural decisions a development team makes about a system. Lacking a clear definition of what is architectural, and also lacking anywhere else to record important decisions, they can start to drift from their original purpose and lose focus and effectiveness.

112
112

More Trending

article thumbnail

How to Bring Workforce Data into the BI Equation

Dataversity

In the current economic environment, employee productivity, efficiency, and well-being have become even more critical to organizational success, mandating that leaders spend more time understanding and deriving insights from employees’ digital footprints and data. But too often, businesses make strategic decisions without factoring in workforce data.

Education 115
article thumbnail

How Lakehouse AI improves model accuracy with real-time computations

databricks

The predictive quality of a machine learning model is a direct reflection of the quality of data used to train and serve the.

105
105
article thumbnail

Article: Agile Rehab: Replacing Process Dogma with Engineering to Achieve True Agility

InfoQ Articles

Struggling with your "agile transformation?" Is your scaling framework not providing the outcomes you hoped for? In this article, we’ll discuss how teams in a large enterprise replaced heavy agile processes with Conway’s Law and better engineering to migrate from quarterly to daily value delivery to the end users.

article thumbnail

Revamping Dasher FAQ Hub Through Server-Driven Content and WebView

DoorDash Engineering

At DoorDash, dashing is highly process dependent. Dashers require a firm grasp of the end-to-end delivery process to complete orders successfully — and earn money. The first iteration of DoorDash support content did more to explain how to dash, handle common delivery issues and pitfalls, and maximize the dashing experience than subsequent iterations have done.

Server 83
article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

article thumbnail

Why Is Data Quality Still So Hard to Achieve?

Dataversity

We exist in a diversified era of data tools up and down the stack – from storage to algorithm testing to stunning business insights. In fact, it’s been more than three decades of innovation in this market, resulting in the development of thousands of data tools and a global data preparation tools market size that’s set […] The post Why Is Data Quality Still So Hard to Achieve?

article thumbnail

How Providence Health Built a Model marketplace using Databricks?

databricks

Providence's MLOps Platform Providence is a healthcare organization with 120,000 caregivers serving over 50 hospitals and 1,000 clinics across seven states. Providence is.

article thumbnail

Apache Kafka Troubleshooting Doesn’t Need to Be Scary: Essential Resources for Developers

Confluent

Debugging Apache Kafka® issues shouldn’t send shivers down your spine. Explore the latest blog posts, on-demand videos, and demos on Kafka troubleshooting to ease your fears.

78
article thumbnail

HN707: Getting Real With Selector’s AIOps (Sponsored)

Packet Pushers

AI and machine learning are finally being applied to networking in meaningful ways. On today's sponsored show we talk with Selector about its AIOps platform, which ingests networking logs, flows, configurations, SNMP, and other telemetry to detect patterns, spot problems, and provide contextual insights to help network engineers do their jobs better.

article thumbnail

Launching LLM-Based Products: From Concept to Cash in 90 Days

Speaker: Christophe Louvion, Chief Product & Technology Officer of NRC Health and Tony Karrer, CTO at Aggregage

Christophe Louvion, Chief Product & Technology Officer of NRC Health, is here to take us through how he guided his company's recent experience of getting from concept to launch and sales of products within 90 days. In this exclusive webinar, Christophe will cover key aspects of his journey, including: LLM Development & Quick Wins 🤖 Understand how LLMs differ from traditional software, identifying opportunities for rapid development and deployment.

article thumbnail

Immutable Storage: A Revolution for AI and Machine Learning Platforms

Dataversity

In the era of data-driven technologies, artificial intelligence (AI) and machine learning (ML) platforms depend on vast amounts of reliable and consistent data. The need for a secure, unalterable data foundation is paramount, and immutable storage has emerged as a vital tool to meet this demand. This article explores how immutable storage integrates with AI […] The post Immutable Storage: A Revolution for AI and Machine Learning Platforms appeared first on DATAVERSITY.

article thumbnail

Announcing GA of Predictive I/O for Updates: Faster DML Queries, Right Out of the Box

databricks

Announcing GA of Predictive I/O for Updates, which harnesses Photon and AI atop Deletion Vectors in order to significantly speed up MERGE, UPDATE and DELETE operations.

105
105
article thumbnail

Getting Started with Generative AI

Confluent

Learn the basics of AI: GPT, LLMs, Generative AI, prompt engineering, how they work, and some large scale use cases. Plus, how to build in GenAI and scale to production.

article thumbnail

WAN Monitoring for Turbocharging WAN Performance

Obkio

Unlock peak WAN Performance with Obkio's NPM Tool. Learn WAN monitoring, troubleshooting &WAN connection optimization strategies. Monitor WAN links easily.

WAN 52
article thumbnail

Generative AI Deep Dive: Advancing from Proof of Concept to Production

Speaker: Maher Hanafi, VP of Engineering at Betterworks & Tony Karrer, CTO at Aggregage

Executive leaders and board members are pushing their teams to adopt Generative AI to gain a competitive edge, save money, and otherwise take advantage of the promise of this new era of artificial intelligence. There's no question that it is challenging to figure out where to focus and how to advance when it’s a new field that is evolving everyday. 💡 This new webinar featuring Maher Hanafi, VP of Engineering at Betterworks, will explore a practical framework to transform Generative AI pr

article thumbnail

Why Master Data Management (MDM) and AI Go Hand in Hand

Dataversity

Organizations have long struggled with the “eternal data problem” – that is, how to collect, store, and manage the massive amount of data their businesses generate. This problem will become more complex as organizations adopt new resource-intensive technologies like AI and generate even more data. By 2025, the IDC expects worldwide data to reach 175 zettabytes, more […] The post Why Master Data Management (MDM) and AI Go Hand in Hand appeared first on DATAVERSITY.

article thumbnail

HS058: Are We Pausing The Technology Cycle?

Packet Pushers

Today we debate its technoloyg is reaching a stable phase. Greg argues that we are in a period of stability, citing resistance to change and a slowdown in advancements. Johna believes that the rise of quantum computing and AI will lead to significant disruptions. They also discuss the future of AI and quantum computing, with Johna predicting a transformative impact by 2026, while Greg suggests a slower adoption due to existing heavy investments in technology.

52
article thumbnail

Case Study - Enabling Secure Remote Work for Alo Yoga/Bella+Canvas with Azure Virtual Desktop

Akins IT

A case study showcasing Alo Yoga/Bella+Canvas' transition to secure remote work with Azure Virtual Desktop, detailing challenges, solutions, and benefits.

52
article thumbnail

How to Detect Network Congestion Like A Pro: Don't Get Jammed Up

Obkio

Learn how to detect network congestion & perform a network congestion test inside & outside your network with Network Monitoring & Network Device Monitoring.

article thumbnail

Reimagined: Building Products with Generative AI

“Reimagined: Building Products with Generative AI” is an extensive guide for integrating generative AI into product strategy and careers featuring over 150 real-world examples, 30 case studies, and 20+ frameworks, and endorsed by over 20 leading AI and product executives, inventors, entrepreneurs, and researchers.

article thumbnail

Semantic Web and AI: Empowering Knowledge Graphs for Smarter Applications

Dataversity

Data is the cornerstone of innovation in today’s highly digital world. However, in its raw state, data isn’t very useful as it lacks meaning and context. This is where the Semantic Web comes in – it provides a framework that imbues data with meaning, allowing machines to understand and process it just as humans do. […] The post Semantic Web and AI: Empowering Knowledge Graphs for Smarter Applications appeared first on DATAVERSITY.

article thumbnail

D2C217: Building Successful Security Operations – Blue Teaming And Beyond

Packet Pushers

On today's Day Two Cloud we talk about how to build a successful security practice within your organization. Our guest is Swathi Joshi, VP, SaaS Cloud Security at Oracle. She breaks down security teams into three core groups: proactive security, defensive security, and assurance (risk reduction, enabling secure access, meeting compliance requirements).

Cloud 52
article thumbnail

Case Study - Ampco Cloud Adoption Using Virtual Desktop

Akins IT

A detailed case study on Ampco's cloud adoption using virtual desktops, highlighting challenges, solutions, and outcomes.

Cloud 52
article thumbnail

How to Monitor Internet SLAs (Service-Level Agreements)

Obkio

Unlock the secrets of Internet SLA monitoring, optimize your online experience, and hold your ISP accountable. Empower your Internet journey!

article thumbnail

A Tale of Two Case Studies: Using LLMs in Production

Speaker: Tony Karrer, Ryan Barker, Grant Wiles, Zach Asman, & Mark Pace

Join our exclusive webinar with top industry visionaries, where we'll explore the latest innovations in Artificial Intelligence and the incredible potential of LLMs. We'll walk through two compelling case studies that showcase how AI is reimagining industries and revolutionizing the way we interact with technology. Some takeaways include: How to test and evaluate results 📊 Why confidence scoring matters 🔐 How to assess cost and quality 🤖 Cross-platform cost vs. quality tr

article thumbnail

Unlocking the Power of Data: Transforming Data Architectures in the Next Data Cycle

Dataversity

As the world becomes ever more data-driven, enterprises and public sector organizations increasingly realize the limitations of relying solely on structured data to gain insights into their business. The next data cycle demands a shift in data architectures that also encompasses the harnessing of unstructured data. In this article, I will shed light on the […] The post Unlocking the Power of Data: Transforming Data Architectures in the Next Data Cycle appeared first on DATAVERSITY.

article thumbnail

Accelerate AWS Access with Arista

Arista Networks

AWS Cloud WAN Tunnel-less Connect and Arista CloudEOS integrate to accelerate cloud onramp As cloud and multicloud adoption continue to evolve, public cloud providers like AWS continue to introduce more and more tools for enterprise IT to choose from. For example, customers can deploy a virtual router in a Transit VPC and BGP peer with AWS Cloud WAN to interconnect on-premises networks and AWS VPCs.

WAN 52
article thumbnail

NB452: Cisco Makes You Feel Vulnerable; Broadcom 25.6Tbps Routing ASIC Targets Custom Silicon; China Mandates IPv6

Packet Pushers

This week's IT news podcast covers a serious Cisco exploit against IOS XE, new firewalls from Juniper, Broadcom's hopes to capture the routing market with merchant silicon, more movement on restoring net neutrality in the US, and more. This week's IT news podcast covers a serious Cisco exploit against IOS XE, new firewalls from Juniper, Broadcom's hopes to capture the routing market with merchant silicon, more movement on restoring net neutrality in the US, and more.

article thumbnail

A Proactive Approach to Network Performance Management

Obkio

Discover how a proactive approach to network performance management can maximize productivity, minimize downtime, and optimize network efficiency.

article thumbnail

LLMOps for Your Data: Best Practices to Ensure Safety, Quality, and Cost

Speaker: Shreya Rajpal, Co-Founder and CEO at Guardrails AI & Travis Addair, Co-Founder and CTO at Predibase

Large Language Models (LLMs) such as ChatGPT offer unprecedented potential for complex enterprise applications. However, productionizing LLMs comes with a unique set of challenges such as model brittleness, total cost of ownership, data governance and privacy, and the need for consistent, accurate outputs. Putting the right LLMOps process in place today will pay dividends tomorrow, enabling you to leverage the part of AI that constitutes your IP – your data – to build a defensible AI strategy fo