May, 2024

article thumbnail

Introducing Confluent Cloud Freight Clusters

Confluent

Confluent Cloud Freight clusters are now available in Early Access. In this blog, learn how Freight clusters can save you up to 90% at GBps+ scale.

Cloud 145
article thumbnail

Introducing Salesforce BYOM for Databricks

databricks

Salesforce and Databricks are excited to announce an expanded strategic partnership that delivers a powerful new integration - Salesforce Bring Your Own Model.

135
135
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Beyond Generative AI and the Future of Innovation

Dataversity

The power of generative AI (GenAI) seems to have no limits. Every day, we see new barriers being broken and new use cases that no one thought possible. And yet, I can’t help but notice that most of these advances we’re hearing about revolve mostly around content creation. While remarkable in its own right, this begs the […] The post Beyond Generative AI and the Future of Innovation appeared first on DATAVERSITY.

Education 124
article thumbnail

Post-quantum readiness for TLS at Meta

Engineering at Meta

Today, the internet (like most digital infrastructure in general) relies heavily on the security offered by public-key cryptosystems such as RSA, Diffie-Hellman (DH), and elliptic curve cryptography (ECC). But the advent of quantum computers has raised real questions about the long-term privacy of data exchanged over the internet. In the future, significant advances in quantum computing will make it possible for adversaries to decrypt stored data that was encrypted using today’s cryptosystems.

TCP 119
article thumbnail

Article: Polyglot Programming with WebAssembly: A Practical Approach

InfoQ Articles

WebAssembly has expanded its scope from browsers to other domains like cloud and edge computing. It uses the WebAssembly Component Model (WCM) to enable seamless interaction between libraries from different programming languages, such as Rust, Python, and JavaScript, promoting a true polyglot programming environment.

article thumbnail

Join us at the Iceberg Summit 2024

Cloudera Blog

Apache Iceberg is vital to the work we do and the experience that the Cloudera platform delivers to our customers. Iceberg, a high-performance open-source format for huge analytic tables, delivers the reliability and simplicity of SQL tables to big data while allowing for multiple engines like Spark, Flink, Trino, Presto, Hive, and Impala to work with the same tables, all at the same time.

article thumbnail

The Art of Lean Governance: What We Can Learn from HAZMAT Professionals

TDAN

The collapse of the Francis Scott Key bridge on March 26, 2024, was a tragic loss of life and disruption to the shipping supply chain on a global scale that will take months, if not years, to fully recover.

More Trending

article thumbnail

Driving Data Governance: The Role of Data Strategy and Data Literacy Programs

Dataversity

In today’s data-driven world, organizations face increasing pressure to manage and govern their data assets effectively. Data governance plays a crucial role in ensuring that data is managed responsibly, securely, and in accordance with regulatory requirements. One key component and driver of successful data governance is the implementation of a robust data strategy coupled with […] The post Driving Data Governance: The Role of Data Strategy and Data Literacy Programs appeared first on DAT

article thumbnail

Composable data management at Meta

Engineering at Meta

In recent years, Meta’s data management systems have evolved into a composable architecture that creates interoperability, promotes reusability, and improves engineering efficiency. We’re sharing how we’ve achieved this, in part, by leveraging Velox , Meta’s open source execution engine, as well as work ahead as we continue to rethink our data management systems.

article thumbnail

Article: You Don’t Need a CSS Framework

InfoQ Articles

Developers use CSS frameworks to reduce boilerplate, increase quality, and drive consistency. However, these gains are hard to maintain as an application’s codebase matures. Developers must configure and override the framework to accommodate changes. Instead of using a CSS framework, developers should write their own custom CSS. CSS has evolved enough that this became the best option.

article thumbnail

We’ll See You at the Gartner Data and Analytics Summit

Cloudera Blog

The Gartner Data and Analytics Summit in London is quickly approaching on May 13 th to 15 th , and the Cloudera team is ready to hit the show floor! The theme of this year’s summit, “Generating Value Together: Creating Synergies between Data, Analytics & AI,” could not have come at a better time as we push forward on our AI and analytics journey together.

article thumbnail

Solving the Dual-Write Problem: Effective Strategies for Atomic Updates Across Systems

Confluent

The dual-write problem can arise in any distributed system. Fortunately, it has solutions in event sourcing & the transactional outbox & listen-to-yourself patterns.

94
article thumbnail

Announcing General Availability of Liquid Clustering

databricks

We’re excited to announce the General Availability of Delta Lake Liquid Clustering in the Databricks Data Intelligence Platform. Liquid Clustering is an innovative.

123
123
article thumbnail

In the Age of AI, How Can We Empower Everyone to Automate Work?

Dataversity

From boosting efficiency to making data-driven decisions faster, the benefits of using AI and automation in the workplace are numerous. But understandably, there’s also plenty of apprehension among some team members. According to new research, around 80% of those who work in a digital setting and use AI say that it’s already improving their productivity.

Education 103
article thumbnail

Behind the scenes of Threads for web

Engineering at Meta

When Threads first launched one of the top feature requests was for a web client. In this episode of the Meta Tech Podcast, Pascal Hartig ( @passy ) sits down with Ally C. and Kevin C., two engineers on the Threads Web Team that delivered the basic version of Threads for web in just under three months. Ally and Kevin share how their team moved swiftly by leveraging Meta’s shared infrastructure and the nimble engineering practices of their colleagues who built Threads for iOS and Android.

article thumbnail

Article: How Netflix Ensures Highly-Reliable Online Stateful Systems

InfoQ Articles

Building reliable stateful services at scale isn’t a matter of building reliability into the servers, the clients, or the APIs in isolation. By combining smart and meaningful choices for each of these three components, we can build massively scalable, SLO-compliant stateful services at Netflix.

Server 102
article thumbnail

What Separates Hybrid Cloud and ‘True’ Hybrid Cloud?

Cloudera Blog

Hybrid cloud plays a central role in many of today’s emerging innovations—most notably artificial intelligence (AI) and other emerging technologies that create new business value and improve operational efficiencies. But getting there requires data, and a lot of it. More than that, though, harnessing the potential of these technologies requires quality data—without it, the output from an AI implementation can end up inefficient or wholly inaccurate.

Cloud 99
article thumbnail

Contributing to Apache Kafka®: How to Write a KIP

Confluent

Learn how to contribute to open source Apache Kafka by writing Kafka Improvement Proposals (KIPs) that solve problems and add features! Read on for real examples.

88
article thumbnail

Executive Overview: The Rise of Open Foundational Models

databricks

Moving generative AI applications from the proof of concept stage into production requires control, reliability and data governance. Organizations are turning to open.

article thumbnail

Automation and AI: Achieving Success Within IaaS

Dataversity

Within the Infrastructure as a Service (IaaS) industry, the adoption of advanced automation technology into data center operations marks a key shift in the technological transformation of IaaS. For data centers aiming to maximize efficiency and minimize human error, implementing advanced automation is a step toward achieving incomparable responsiveness and scalability.

IaaS 94
article thumbnail

The New Era of AI Centers

Arista Networks

In 1984, Sun was famous for declaring, “The Network is the Computer.” Forty years later we are seeing this cycle come true again with the advent of AI. The collective nature of AI training models relies on a lossless, highly-available network to seamlessly connect every GPU in the cluster to one another and enable peak performance. Networks also connect trained AI models to end users and other systems in the data center such as storage, allowing the system to become more than the sum of its part

article thumbnail

Article: Introducing the RIG Model - The Puzzle of Designing Guaranteed Data-Consistent Microservice Systems

InfoQ Articles

The RIG model formulates three rules for a saga call chain. Using a gamified RIG tool, consisting of three main RIG puzzle pieces, teams can model a microservice system that guarantees eventual data consistency.

92
article thumbnail

Six Clouderans Earn CRN Women of the Channel Distinction

Cloudera Blog

Businesses today face unique challenges, whether it’s with hybrid cloud, AI, data analytics, or all of the above. Delivering solutions that can address those challenges effectively requires a robust ecosystem of partnerships. At the center of this critical ecosystem is the partner marketing team at Cloudera, who work tirelessly in pursuit of excellence for customers—and as a result, we’re proud to share that six of our very own Clouderans have been recognized by CRN as part of this year’s Women

LAN 96
article thumbnail

Key Moments From Kafka Summit Bangalore: AI Model Inference, Freight Clusters, and More

Confluent

A lookback at all the exciting happenings at our first-ever Kafka Summit Bangalore—and some key announcements, including Confluent Platform for Apache Flink.

81
article thumbnail

How to Crush the Spider Benchmark with Ease on Databricks

databricks

How we reached 79.9% on the Spider dev dataset with Llama3 8B through savvy prompting and fine-tuning on Databricks.

121
121
article thumbnail

Granularity Is the True Data Advantage

Dataversity

Commerce today runs on data – guiding product development, improving operational efficiency, and personalizing the customer experience. However, many organizations fall into the trap of thinking that more data means more sales, when these two factors aren’t directly correlated. Often, executives will become overzealous in their digital transformations and cut blank checks for data collection, […] The post Granularity Is the True Data Advantage appeared first on DATAVERSITY.

article thumbnail

Eyes on Data: Improving ESG Reporting with Established Industry Standards

TDAN

In today’s rapidly evolving corporate landscape, environmental, social, and governance (ESG) reporting has become a focal point for organizations aiming to demonstrate their commitment to sustainability and responsible business practices and comply with a growing roster of regulations.

article thumbnail

Article: How to Build and Foster High-performing Software Teams: Experiences from Engineering Managers

InfoQ Articles

Engineering managers can enable software teams to learn and improve, and help them move problems and impediments out of the way. In this virtual panel, we'll discuss how engineering managers support teams, what skills they possess, and how they establish alignment and foster knowledge and experience sharing between teams.

article thumbnail

Laying the Foundation for Modern Data Architecture

Cloudera Blog

Behind every business decision, there’s underlying data that informs business leaders’ actions. As the market landscape across verticals from financial services to healthcare and manufacturing grows increasingly competitive, those decisions need to happen ever faster and to make them, businesses need to rely on data to reveal insights quickly, as near-real-time as possible.

article thumbnail

Introducing Confluent Cloud OpenSearch Sink Connector

Confluent

Confluent’s OpenSearch Sink Connector lets you easily send events to AWS OpenSearch and others—enabling fraud detection, log analytics, social media monitoring & GenAI w/RAG.

Media 75
article thumbnail

Introducing Databricks Assistant Autocomplete

databricks

We are excited to introduce Databricks Assistant Autocomplete now in Public Preview. This feature brings the AI-powered assistant to you in real-time, providing.

120
120
article thumbnail

How to Assess GenAI’s Impact on Your Business

Dataversity

Since the beginning of 2023, generative AI (GenAI) has quickly made a significant impact across an expanding range of industries and applications. In just over a year since its groundbreaking debut, there’s much to celebrate about GenAI – and even more to still uncover and understand. Today, 79% of employees report at least some exposure to AI, […] The post How to Assess GenAI’s Impact on Your Business appeared first on DATAVERSITY.

article thumbnail

Session Replay: Bringing qualitative insights to Mixpanel

Mixpanel

We’re excited to announce Mixpanel Session Replay is now available in beta. Up-level your customer understanding by combining quantitative insights with replays of real-time user clicks. People know and love Mixpanel for easy, fast access to customer journey data at the aggregated level. We’re making it even easier to zoom in and literally see how individuals move through your product.

article thumbnail

Article: Experimenting with LLMs for Developer Productivity

InfoQ Articles

This article describes an experiment that sought to determine if no-cost LLM-based code generation tools can improve developer productivity. The experiment evaluated several LLMs by generating unit tests for some open-source code and measuring the code coverage as well as the manual rework necessary to make the tests work.

article thumbnail

Bringing Financial Services Business Use Cases to Life: Leveraging Data Analytics, ML/AI, and Gen AI

Cloudera Blog

The financial services industry is undergoing a significant transformation, driven by the need for data-driven insights, digital transformation, and compliance with evolving regulations. In this context, Cloudera and TAI Solutions have partnered to help financial services customers accelerate their data-driven transformation, improve customer centricity, ensure compliance with regulations, enhance risk management, and drive innovation.

article thumbnail

Introducing the Connect with Confluent Partner Landscape and Q2 Program Entrants

Confluent

Confluent introduces the CwC partner landscape and new program entrants for Q2 2024.

75
article thumbnail

Databricks Assistant Tips & Tricks for Data Engineers

databricks

The generative AI revolution is transforming the way that teams work, and Databricks Assistant leverages the best of these advancements. It allows you.