Sat.Jun 17, 2023 - Fri.Jun 23, 2023

article thumbnail

Article: Debugging Production: eBPF Chaos

InfoQ Articles

This article shares insights into learning eBPF as a new cloud-native technology which aims to improve Observability and Security workflows. You’ll learn how chaos engineering can help, and get an insight into eBPF based observability and security use cases.

article thumbnail

How Databricks’ Lakehouse is helping to power a new era for TD Bank Group's Data Transformation

databricks

This blog is the first of a 3-part series chronicling TD Bank's Data Platform transformation and the enablement of their Data as a.

Banking 101
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

Trending Sources

article thumbnail

Data Bias in AI – Can We Beat Evolution Using Technology?

Dataversity

Is there data bias in your business? Recent research indicates that 65% of business and IT executives believe there is currently data bias in their organization, 13% of businesses are currently addressing data bias, and 78% believe data bias will become a bigger concern as AI/ML use increases. What this indicates is that businesses and organizations simultaneously worry […] The post Data Bias in AI – Can We Beat Evolution Using Technology?

article thumbnail

How DoorDash Built an Ensemble Learning Model for Time Series Forecasting

DoorDash Engineering

In real-world forecasting applications , it is a challenge to balance accuracy and speed. We can achieve high accuracy by running numerous models and configuration combinations and we gain speed through running fast, computationally inexpensive models. We explore a number of models and configuration combinations at DoorDash to forecast demand on our platform.

article thumbnail

Article: Shift in Sprint Review Mindset: from Reporting to Inclusive Ideation

InfoQ Articles

Sprint Reviews should foster a dynamic environment of creativity, exploration, and continual refinement, where important product and overall business decisions are taken. In this article, we will explore the substantial mindset shift and routine change from a typical reporting-focused to interactive data-driven culture of Sprint Reviews.

98
article thumbnail

Accelerating Innovation at JetBlue Using Databricks

databricks

This blog is authored by Sai Ravuru Senior Manager of Data Science & Analytics at JetBlue The role of data in the aviation.

85
article thumbnail

Auditing Database Access and Change

TDAN

The increasing burden of complying with government and industry regulations imposes significant, time-consuming requirements on IT projects and applications. And nowhere is the pressure to comply with regulations greater than on data stored in corporate databases. Organizations must be hyper-vigilant as they implement controls to protect and monitor their data.

More Trending

article thumbnail

Article: A Comprehensive Guide to Building Event-Driven Architecture on Azure, AWS, and Google Cloud

InfoQ Articles

In this article, you'll find guidance to Azure, AWS, and Google Cloud resources, along with unique architecture examples that incorporate the AWS EventBridge, SNS, Azure Service Bus, Eventgrid, and Google Cloud Eventarc.

Cloud 81
article thumbnail

Databricks on AWS Guide to Data + AI Summit 2023 featuring Labcorp, Conde Nast, Grammarly, Vizio, NTT Data, Impetus, Amgen, and YipitData

databricks

This is a collaborative post from Databricks and Amazon Web Services (AWS). We thank Venkat Viswanathan, Data and Analytics Strategy Leader, Partner Solutions.

84
article thumbnail

Through the Looking Glass: The Sounds of Data, Part 2

TDAN

In Part 1 of The Sounds of Data, I wrote about the power of sonification, which translates data into sounds and music. I finished the article with a cliffhanger.

article thumbnail

Q&A—How Wealthsimple Builds API Financial Solutions with Confluent

Confluent

See why Wealthsimple chose Confluent to build real-time API financial solutions that could process, transform, and govern real-time data for downstream systems.

article thumbnail

ChatGPT: Unleashing the Power of Customization for Enterprise Apps

Vedcraft

With the rise of OpenAIs ChatGPT , there is a huge momentum to experiment, ideate, and create innovative solutions unleashing the power of ChatGPT. This blogs focus is to explore the currently available possibilities to customize OpenAIs ChatGPT as per your enterprises requirements. Table of Contents [Open] [Close] #1 Static & Dynamic Prompt Engineering #2 Embedding Your Data with Retrieval Augmented Generation (RAG) #3 Fine-tuned Model with Your Enterprise Data #4 Extend the functionali

article thumbnail

Build governed pipelines with Delta Live Tables and Unity Catalog

databricks

We are excited to announce the public preview of Unity Catalog support for Delta Live Tables (DLT). With this preview, any data team.

article thumbnail

How Security Teams can Leverage MITRE ATT&CK and How Cato Networks’ SASE can Help

CATO Networks

In a recent poll we conducted, two thirds of respondents shared they were unaware of the MITRE ATT&CK Framework or were only beginning to understand what it can provide. When used correctly, MITRE ATT&CK can significantly help organizations bolster their security posture. In this blog post, we explain how security teams can leverage MITRE ATT&CK and how Cato Networks SASE can help.

SASE 52
article thumbnail

When to Use AutoML vs. Manual ML: A Full Guide

Dataversity

Automated machine learning (AutoML) is a set of tools and techniques that automate the design, training, and deployment of machine learning models. AutoML has become essential due to the amount of data involved when creating ML models, helping to save a significant amount of time, human resources, and money. Although manual machine learning is not obsolete, automating […] The post When to Use AutoML vs.

article thumbnail

Geo-blocking at the BGP Level

Noction

The implementation of geo-blocking at the BGP level offers network operators a powerful tool to exert control over the internet traffic. By utilizing BGP communities and BGP FlowSpec, operators can efficiently tag and filter routes based on IP address ranges, effectively restricting access based on geographic regions.

article thumbnail

Advancing Business with Data & AI: Announcing the Finalists for the 2023 Databricks Data Team Transformation Award

databricks

The annual Data Team Awards showcase how different enterprise data teams are delivering solutions to some of the world’s toughest problems. Nearly 300 n.

79
article thumbnail

Oxidizing OCaml: Rust-Style Ownership

Jane Street

OCaml with Jane Street extensions is available from our public opam repo. Only a slice of the features described in this series are currently implemented.

52
article thumbnail

Logical Data Management for Environmental, Social, and Governance (ESG) Initiatives

Dataversity

Driven in large part by a growing awareness of the effects of unchecked carbon emissions, environmental, social, and governance (ESG) initiatives have been gaining momentum across companies in Europe and, more recently, the U.S. Some verticals, notably financial services, are beginning to tie ESG information directly to investment decisions, while all companies are realizing that […] The post Logical Data Management for Environmental, Social, and Governance (ESG) Initiatives appeared first

article thumbnail

IRP 4.2 is here, featuring advanced BGP FlowSpec Geo-blocking Capability

Noction

Noction Intelligent Routing Platform (IRP) v4.2 has just been released. This update introduces an array of exciting new features and enhancements, including the advanced BGP FlowSpec geo-blocking capability.

52
article thumbnail

A guide to data and AI governance and sharing talks at the Data + AI Summit 2023

databricks

The countdown is on for the highly anticipated Data + AI Summit! Whether you're joining us in person or virtually, get ready for.

article thumbnail

Get Rid of Data Silos

TDAN

All business is, to some extent, a data-driven endeavour. Whether it be marketing, planning, or customer service, knowledge is power. Your company needs a system for effectively managing data. One of the great enemies of a good system is data silos. What are Data Silos? As your business develops, it gathers more and more data.

article thumbnail

3 Reasons Manufacturers Must Get Data Governance Right in 2023

Dataversity

In the manufacturing space, digital transformation has made data the oil in many machines – and much like oil, it needs refinement and enrichment. This can be carried out via Data Governance. Good Data Governance translates to smarter, quicker, data-driven decisions, as well as more efficient resource management, reduced security risks, greater trust from customers […] The post 3 Reasons Manufacturers Must Get Data Governance Right in 2023 appeared first on DATAVERSITY.

article thumbnail

Multi-Protocol Label Switching – Transport Profile (MPLS-TP) and Configuration

Noction

MPLS-TP is a carrier-grade transport platform well-suited for edge, aggregation, and access networks. MPLS-TP provides the predictability and reliability of circuit-based transport networks, making it an attractive option for carriers who require a deterministic transport solution.

MPLS 52
article thumbnail

Delivering Business Value by Unifying Data, Analytics and AI: Announcing the Finalists for the 2023 Databricks Unified Lakehouse Award

databricks

The annual Data Team Awards showcase how different enterprise data teams are delivering solutions to some of the world’s toughest problems. Nearly 300 n.

71
article thumbnail

NIDG Perspective: A Trusted Trainer for Data

TDAN

This column is a stand-in for a new column that will be announced for the 3rd month each quarter starting next cycle. I am pleased to fill in essays like this from time-to-time that provide additional perspective to the Non-Invasive Data Governance approach. You may recall a TDAN.

article thumbnail

Unlock the Power of Data with Unified Data Controls

Dataversity

Artificial intelligence (AI) could boost company productivity by 1.5%, increasing S&P 500 profits by 30% over the next 10 years. The rapid success of generative AI technologies such as ChatGPT is an excellent example of how companies can shape their fortunes by harnessing the power of the data they hold. The insights from data enable businesses across […] The post Unlock the Power of Data with Unified Data Controls appeared first on DATAVERSITY.

article thumbnail

NB435: Your FUs, VMware takeover, DPU News and Cooling is Toxic

Packet Pushers

FU, vendors co-operating ? Google ditches something, Quantum computing, the state of AMD DPUs. Finally liquid cooling is toxic due to PFAS are 'forever chemicals'. FU, vendors co-operating ? Google ditches something, Quantum computing, the state of AMD DPUs. Finally liquid cooling is toxic due to PFAS are 'forever chemicals'.

52
article thumbnail

Azure Databricks Guide to Data + AI Summit 2023 featuring Akamai, Providence Health Services, ABN Amro, Bradesco, and Department of Veterans Affairs.

databricks

This is a collaborative post from Databricks and Microsoft Azure. We thank Rajeev Jain, Senior Product Marketing Manager at Microsoft, for his contributions.

65
article thumbnail

Who Needs A Data Model Anyway?

TDAN

These days, there is much conversation about the necessity of the data model. The data model has been around for several decades now and can be classified as an artifact of an earlier day and age. But is the data model really out of date? And exactly why do we need a data model, anyway?

article thumbnail

A Picture Is Worth 1,000 Words: The Importance of Data Visualization

Dataversity

Have you ever heard the saying, “A picture is worth 1,000 words”? This statement holds especially true in the field of Data Science. Let’s say you are a data scientist at a top Fortune company, dealing with budget portfolio optimizations worth millions of dollars annually for various clients. It is essential to effectively communicate your […] The post A Picture Is Worth 1,000 Words: The Importance of Data Visualization appeared first on DATAVERSITY.

article thumbnail

Tech Byte: DWDM at the Edge with Nokia PSE6 Coherent Optics

Packet Pushers

Todays Tech Byte is a discussion on Nokias Photonic Service Engine (PSE) optics. Release 6 of its PSEs promises huge changes to DWDM Edge by bringing coherent optical DWDM circuits directly to your Nokia routers and switches. No more costly DWDM shelves and transponders just to terminate a tail circuit, reducing lead times and providing more options for resilience.

Routers 52
article thumbnail

The future of healthcare relies on data collaboration: how IQVIA and the Databricks Lakehouse enable better outcomes

databricks

The ability to ingest, unify, and share healthcare data plays a foundational role in driving new innovations, advancing medical research, and improving patient.

article thumbnail

Effective Use of Generative-AI

TDAN

While Generative-AI has undoubtably demonstrated powerful capabilities in generating images, music, and text, it is essential to approach the technology’s potential with a balanced and realistic outlook. The notion that Generative-AI will serve as a universal panacea for all industries is overly optimistic.

article thumbnail

Testing and Monitoring Data Pipelines: Part Two

Dataversity

In part one of this article, we discussed how data testing can specifically test a data object (e.g., table, column, metadata) at one particular point in the data pipeline. While this technique is practical for in-database verifications – as tests are embedded directly in their data modeling efforts – it is tedious and time-consuming when end-to-end data […] The post Testing and Monitoring Data Pipelines: Part Two appeared first on DATAVERSITY.

article thumbnail

Article: Exploring Java Records Beyond Data Transfer Objects

InfoQ Articles

Records are a concise and easy-to-use syntax for creating immutable classes. By using Records, you can ensure that your APIs are bulletproof and less prone to errors. Additionally, Records can be applied with Domain-Driven Design (DDD) principles to create more robust and maintainable code. Learning to use Records and apply them with DDD can help you make more resilient and scalable applications.

article thumbnail

Unleashing the Power of AI and Machine Learning: A Sneak Peek into Data and AI Summit Sessions

databricks

The Data and AI Summit is just around the corner, promising an unparalleled opportunity to delve into the world of artificial intelligence (AI).