databricks

JUNE 3, 2024

We are excited to announce that we have agreed to acquire Tabular, Inc, a data management company founded by Ryan Blue, Daniel Weeks.

145

145

Architect Elevator

JUNE 29, 2024

Yes, you can make money writing books. But never do it for that.

141

141

Engineering at Meta

JUNE 12, 2024

As we continue to focus our AI research and development on solving increasingly complex problems, one of the most significant and challenging shifts we’ve experienced is the sheer scale of computation required to train large language models (LLMs). Traditionally, our AI model training has involved a training massive number of models that required a comparatively smaller number of GPUs.

Infiniband 141

Infiniband Data Centers Topology Network 141

Faris Malaeb

JUNE 28, 2024

Managing email quarantine in Exchange Online is a regular and important task for maintaining a secure and efficient email environment. Exchange Online provides robust PowerShell cmdlets to handle quarantine messages effectively. Today you will learn the essential cmdlets for managing Exchange Online quarantine messages, ensuring you can handle them with ease and precision.

Email 130

Email 130

Confluent

JUNE 25, 2024

Leverage Confluent’s data streaming platform to continuously ingest, process, and analyze logs to strengthen your cybersecurity and SIEM.

120

120

InfoQ Articles

JUNE 13, 2024

In this article, we will explore the challenges, strategies, and best practices that will help you achieve seamless log management in your Kubernetes environment.

DevOps 110

DevOps Cloud 110

databricks

JUNE 12, 2024

Over the last year, we have seen a surge of commercial and open-source foundation models showing strong reasoning abilities on general knowledge tasks.

140

140

Engineering at Meta

JUNE 12, 2024

Meta is currently operating many data centers with GPU training clusters across the world. Our data centers are the backbone of our operations, meticulously designed to support the scaling demands of compute and storage. A year ago, however, as the industry reached a critical inflection point due to the rise of artificial intelligence (AI), we recognized that to lead in the generative AI space we’d need to transform our fleet.

Fashion 138

Fashion Data Centers Artificial Intelligence Server 138

Faris Malaeb

JUNE 2, 2024

Incorrect or missed configurations can lead to errors causing mailbox provisioning failures. One such error, often encountered in the Microsoft Admin Center, is represented by the message: “Exchange Online: An unknown error has occurred. Refer to correlation ID GUID.” This post will help you understand how to identify the cause of this error and provide.

130

130

Confluent

JUNE 17, 2024

Improve REST API response data w/Kafka and Flink SQL in Confluent Cloud; Automatic connector retriability combats REST flakiness; Demo w/OpenSky data.

Cloud 105

Cloud 105

InfoQ Articles

JUNE 18, 2024

In this article, we will walk through creating a basic eBPF program in Rust. We will intentionally include a performance regression and then use profilers to locate and fix the bug. We will also create benchmarks and track them using a continuous benchmarking tool for CI.

DevOps 109

DevOps 109

databricks

JUNE 13, 2024

We are excited to announce that we are open sourcing Unity Catalog, the industry’s first open source catalog for data and AI governance.

Government 137

Government 137

Cloudera Blog

JUNE 17, 2024

Pride Month is underway and we at Cloudera are looking forward to joining the global celebration of diversity, equity and the ongoing effort for LGBTQ+ ( L esbian, G ay, B isexual, T ransgender, Q ueer/ Q uestioning) rights and recognition. Pride Month serves as a reminder that the fight for equality and equity for members of the LGBTQ+ community is not over.

108

108

Engineering at Meta

JUNE 10, 2024

At Meta, Bento , our internal Jupyter notebooks platform, is a popular tool that allows our engineers to mix code, text, and multimedia in a single document. Use cases run the entire spectrum from what we call “lite” workloads that involve simple prototyping to heavier and more complex machine learning workflows. However, even though the lite workflows require limited compute, users still have to go through the same process of reserving and provisioning remote compute – a process that takes time

Server 115

Server Engineering Port JavaScript 115

Dataversity

JUNE 27, 2024

The insurance industry is undergoing a revolution, mainly driven by the application of advanced emerging technologies. The application and installation of new technologies enable a better future for our industry, where customers will receive maximum efficiency, security, and flexibility. Here, we address the major technologies and trends that influence this transition, shedding light on their […] The post The Future of Insurance: A Business Analyst’s Insight into Emerging Trends and Techno

Insurance 98

Insurance Application IoT Education 98

TDAN

JUNE 19, 2024

AI governance has become a critical topic in today’s technological landscape, especially with the rise of AI and GenAI. As CEOs express concerns regarding the potential risks with these technologies, it is important to identify and address the biggest risks.

Government 98

Government Artificial Intelligence Education 98

InfoQ Articles

JUNE 19, 2024

Gen AI Assistants play to the strengths of professionals with a breadth of experience, particularly software developers who can describe what they want the LLM to complete and critically evaluate the result. These tools enable us to swiftly cross divides of domain language and scale large repetitive tasks down to interesting ones on a human scale.

Artificial Intelligence 109

Artificial Intelligence Engineering 109

databricks

JUNE 13, 2024

Today, we are excited to announce Databricks LakeFlow, a new solution that contains everything you need to build and operate production data pipelines.

Engineering 137

Engineering 137

Cloudera Blog

JUNE 13, 2024

Hadoop. The first time that I really became familiar with this term was at Hadoop World in New York City some ten or so years ago. There were thousands of attendees at the event – lining up for book signings and meetings with recruiters to fill the endless job openings for developers experienced with MapReduce and managing Big Data. This was the gold rush of the 21st century, except the gold was data.

Banking 103

Banking Insurance Cloud Healthcare 103

Engineering at Meta

JUNE 24, 2024

We’re sharing how we streamline system reliability investigations using a new AI-assisted root cause analysis system. The system uses a combination of heuristic-based retrieval and large language model-based ranking to speed up root cause identification during investigations. Our testing has shown this new system achieves 42% accuracy in identifying root causes for investigations at their creation time related to our web monorepo.

Engineering 111

Engineering Application 111

Dataversity

JUNE 3, 2024

Hello! I’m Mark Horseman, and welcome to The Cool Kids Corner. This is my monthly check-in to share with you the people and ideas I encounter as a data evangelist with DATAVERSITY. (Last month, we discussed data leadership.) This month, we’re talking about lifelong learning. In the Data Management space, what drives us to learn […] The post The Cool Kids Corner: Lifelong Learning appeared first on DATAVERSITY.

Digital Transformation 98

Digital Transformation Education 98

Confluent

JUNE 27, 2024

Deploy Apache Kafka® at the edge with Confluent to avoid complexities and constraints while accelerating innovation with an enterprise-grade data streaming platform.

80

80

InfoQ Articles

JUNE 6, 2024

Spring Boot stands out as a viable framework for its agility and streamlined workflow. Yet, effective configuration management remains a pivotal factor influencing deployment efficiency and ongoing maintenance. ConfigMaps, a feature in Kubernetes, provides configuration strategies for Spring Boot applications.

Application 106

Application DevOps Engineering 106

databricks

JUNE 11, 2024

Today, we are excited to announce Databricks AI/BI , a new type of business intelligence product built from the ground up to deeply.

137

137

Cloudera Blog

JUNE 11, 2024

More than two-thirds of companies are currently using Generative AI (GenAI) models, such as large language models (LLMs), which can understand and generate human-like text, images, video, music, and even code. However, the true power of these models lies in their ability to adapt to an enterprise’s unique context. By leveraging an organization’s proprietary data, GenAI models can produce highly relevant and customized outputs that align with the business’s specific needs and ob

Financial 93

Financial Banking Pharmaceuticals Email 93

Engineering at Meta

JUNE 25, 2024

The history of Rust at Meta goes all the way back to 2016, when we first started using it for source control. Today, it has been widely embraced at Meta and is one of our primary supported server-side languages (along with C++, Python, and Hack). But that doesn’t mean there weren’t any growing pains. Aida G., a member of one of Meta’s first Rust teams, joins Pascal Hartig ( @passy ) on the latest Meta Tech Podcast to dive into the challenges of getting Rust to interact with Meta’s large amount o

Engineering 102

Engineering Server 102

Dataversity

JUNE 3, 2024

With spending on digital transformation initiatives worldwide projected to hit $3.9 trillion by 2027, the pressure is on organizations – and specifically the C-suite – to ensure that not only are they best positioned to tackle the digital challenges of today but that they can quickly adapt to those of tomorrow as well. C-suite leaders find themselves […] The post Key Considerations for C-Suite Leaders Involved in Digital Transformation Initiatives appeared first on DATAVERSITY.

Digital Transformation 78

Digital Transformation Government Education 78

Confluent

JUNE 27, 2024

Struggling to get your GenAI app off the ground? You’re not alone—GenAI apps can be challenging to build. Luckily, taking an event-driven approach can make the process more manageable. Learn how.

80

80

InfoQ Articles

JUNE 28, 2024

As systems become larger and more complex we need to take the concepts of platform engineering to a higher level – to the code level – by creating platforms and abstractions that will reduce cognitive load, help simplify and accelerate software development, and allow for easy maintenance and upgrades to the platform. Let’s move from “platform” to “Platform as a Runtime”.

Engineering 105

Engineering Cloud 105

databricks

JUNE 12, 2024

“FactSet’s mission is to empower clients to make data-driven decisions and supercharge their workflows and productivity. To deliver AI-driven solutions across our entire.

Financial 135

Financial 135

Cloudera Blog

JUNE 21, 2024

Juneteenth holds profound significance in the history of freedom and equality for Black Americans. Also known as Freedom Day or Emancipation Day, Juneteenth commemorates the anniversary of June 19, 1865, when news of the Emancipation Proclamation reached Galveston, Texas, finally declaring freedom for enslaved Americans held in the Confederacy–more than two years after the proclamation was issued in on January 1, 1863.

Education 83

Education 83

Engineering at Meta

JUNE 11, 2024

MobileConfig enables developers to centrally manage a mobile app’s configuration parameters in our data centers. Once a parameter value is changed on our central server, billions of app devices automatically fetch and apply the new value without app updates. These remotely managed configuration parameters serve various purposes such as A/B testing, feature rollout, and app personalization.

Real Estate 99

Real Estate Protocol Application Engineering 99

Scott's Weblog

JUNE 28, 2024

Welcome to Technology Short Take #179! I’m back with another set of links to articles on various data center- and IT-related topics. In the interest of full transparency, I’d like to give credit to Russ White for his “Weekend Reads” series of posts, which are similar in nature to my Technology Short Takes. If you aren’t reading Russ’ “Weekend Reads” posts, you’re missing out on a good source of useful information.

Topology 75

Topology Data Centers Network Networking 75

Confluent

JUNE 26, 2024

Our OSS on Azure Partner of the Year Award highlights Confluent's data streaming solution, cloud Apache Kafka, and fully integrated Azure security, management, billing, and data analytics.

Cloud 78

Cloud 78

InfoQ Articles

JUNE 5, 2024

A single line of code can shape an organization's financial future. Erik Peterson, the CTO and founder at CloudZero, presented an engineering perspective on cloud cost optimization at QCon San Francisco.

Engineering 98

Engineering Cloud Financial DevOps 98

databricks

JUNE 5, 2024

We are excited to announce that Forrester has recognized Databricks as a Leader in The Forrester Wave™: AI Foundation Models for Language, Q2.

131

131

Cloudera Blog

JUNE 6, 2024

Recently, Cloudera, alongside OCBC, were named winners in the“ Best Big Data and Analytics Infrastructure Implementation ” category at The Asian Banker’s Financial Technology Innovation Awards 2024. This recognition underscores the importance of trusted data when building AI and generative AI (GenAI) models and serves as a testament to the impact that reliable data can have in real world use cases.

Banking 83

Banking Encryption Financial Application 83