Engineering at Meta

JANUARY 27, 2023

Managing network solutions amidst a growing scale inherently brings challenges around performance, deployment, and operational complexities. At Meta, we’ve found that these challenges broadly fall into three themes: 1.) Data center networking: Over the past decade, on the physical front, we have seen a rise in vendor-specific hardware that comes with heterogeneous feature and architecture sets (e.g., non-blocking architecture).

Engineering 142

Engineering Network Networking Data Centers 142

InfoQ Articles

JANUARY 25, 2023

In this article, Rogerio Robetti discusses the challenges in auto-scaling stateful storage systems and proposes an opinionated design solution to automatically scale up (vertical) and scale out (horizontal) from a single node up to several nodes in a cluster with minimum configuration and interference of the operator.

Engineering 142

Engineering 142

Faris Malaeb

JANUARY 25, 2023

ChatGPT API allows developers to integrate the capabilities of ChatGPT into their applications easily. OpenAI provides the ChatGPT API, which can be accessed via an API key. The API endpoint allows you to send a prompt and receive a generated response. With its ability to understand and develop human-like text, the ChatGPT API is a. The post Interact with ChatGPT API Using Postman or PowerShell appeared first on Faris Malaeb.

Application 130

Application 130

databricks

JANUARY 26, 2023

This is a collaborative post from Databricks and wisecube.ai. We thank Vishnu Vettrivel, Founder, and Alex Thomas, Principal Data Scientist, for their contributions.

111

111

Engineering at Meta

JANUARY 26, 2023

The technical journey discusses the motivations, challenges, and technical solutions employed for warehouse schematization, especially a change to the wire serialization format employed in Meta’s data platform for data interchange related to Warehouse Analytics Logging. Here, we discuss the engineering, scaling, and nontechnical challenges of modernizing Meta’s exabyte-scale data platform by migrating to the new Tulip format.

Engineering 111

Engineering Application Protocol 111

InfoQ Articles

JANUARY 23, 2023

Technology has taken significant leaps within the last few years, introducing advancements that have taken us further into the digital age — impacting the software testing industry and we're seeing advances in machine learning, artificial intelligence, and the neural networks making them possible. These new technologies will change how software is developed and tested like never before.

Artificial Intelligence 132

Artificial Intelligence Network Networking 132

Dataversity

JANUARY 24, 2023

Data-driven decision-making is a critical aspect of modern business operations, with most organizations leveraging enterprise applications to execute their business processes easily and effectively. However, the users of these tools have historically needed to make a majority of their decisions manually, outside the software, creating inefficiencies that have a negative impact on operations.

Application 98

Application Artificial Intelligence Education 98

DoorDash Engineering

JANUARY 24, 2023

As DoorDash’s business has grown with increasing order volumes and through emerging businesses including grocery delivery, our customer support experience also needed to scale up efficiently. The legacy support application that DoorDash had built to issue credits and refunds was created only to address the original food delivery service. It couldn’t handle the needs of our new verticals.

Application 72

Application Engineering 72

InfoQ Articles

JANUARY 24, 2023

Platform engineering is a current hot topic with a rapidly growing tooling ecosystem and landscape. This article reviews many of the important trends in Platform Engineering.

Engineering 114

Engineering PaaS DevOps 114

Dataversity

JANUARY 26, 2023

AI and data science have remained areas of focus in the last year and will continue to be top of mind for many tech companies in the coming year. Wearables, especially those with health monitoring capabilities, have also grown abundant as medical and consumer companies alike ramp up their offerings in response to increased demand. […] The post What to Expect from AI, Data Science, and Wearables in Health Care in 2023 appeared first on DATAVERSITY.

Artificial Intelligence 98

Artificial Intelligence Education 98

databricks

JANUARY 24, 2023

We are excited to announce a new AutoML capability to quickly and easily use Feature Store data to improve model outcomes. AutoML users.

91

91

Confluent

JANUARY 25, 2023

Confluent’s leading command-line tool for managing enterprise Kafka deployments and modern data flow—is now source available.

64

64

InfoQ Articles

JANUARY 26, 2023

While Wasm was originally designed for the browser, it turned out to be useful for embedded programming, plugins, cloud, and edge computing. For all these use cases, performance is tremendously important and is greatly impacted by file size. In this article, we’ll look at six ways to optimize Wasm for performance and file size.

Cloud 105

Cloud 105

Packet Pushers

JANUARY 27, 2023

Would you give an artificial intelligence responsibility to write your router configurations? You wouldnt. Not yet. But were not as far from that as you might think. On today's Heavy Networking we dig into OpenAI and ChatGPT and what it might mean for networking. Would you give an artificial intelligence responsibility to write your router configurations?

Artificial Intelligence 52

Artificial Intelligence Network Networking Routers 52

databricks

JANUARY 26, 2023

This is part two of a three-part series in Best Practices and Guidance for Cloud Engineers to deploy Databricks on AWS. You can.

Engineering 89

Engineering Cloud 89

Dataversity

JANUARY 27, 2023

How often do you take the time to fill out feedback forms or surveys about the products and services you use? If you’re part of a customer marketing team, you know that most people would say “not very often.” This is precisely the plight of the average customer marketer. Up until recently, feedback forms and […] The post How Reverse ETL Powers Modern Customer Marketing: Concrete Examples appeared first on DATAVERSITY.

Education 52

Education 52

InfoQ Articles

JANUARY 27, 2023

This article presents better solutions that employ data from the system under test and the tests themselves to optimize testing efforts. This allows teams to find more bugs (by making sure that bug-dense areas are tested) in less time (by reducing the executions of tests that are very unlikely to detect bugs).

72

72

Packet Pushers

JANUARY 26, 2023

In today's IPv6 Buzz podcast, Ed, Scott, and Tom speak withJad El Cham about the RIPE NCC IPv6 training program as well as RIPE NCC's role as theEuropean and Middle Eastern Regional Internet Registry providing Internet resources including IPv6 addresses. In today's IPv6 Buzz podcast, Ed, Scott, and Tom speak withJad El Cham about the RIPE NCC IPv6 training program as well as RIPE NCC's role as theEuropean and Middle Eastern Regional Internet Registry providing Internet resources including IPv6 a

Internet 52

Internet 52

databricks

JANUARY 23, 2023

This is a collaborative post from Databricks and Census. We thank Parker Rogers, Data Community Advocate, at Census for his contributions. In this.

87

87

Eventbrite

JANUARY 26, 2023

A few times each year, Eventbrite’s research team launches surveys to find out more about you — the people who organize events on Eventbrite and your event attendees. Your invaluable input guides us in designing features and offerings that are well-suited to your needs, and helps us better shape our plans moving forward.

52

52

Obkio

JANUARY 25, 2023

Learn how to use Obkio Network Monitoring to identify & check packet loss in your network. Check for packet loss affecting your LAN, WAN, devices and apps.

LAN 52

LAN WAN Network Networking 52

Packet Pushers

JANUARY 25, 2023

On today's Day Two Cloud podcast we talk about Compute Express Link (CXL), a technology for composable infrastructure. The idea is to take all the peripherals in a system network cards, memory, graphical processing units, and so on and put them on a bus outside the chassis to share them among multiple hosts. Is this the dream of composable infrastructure coming true?

Cloud 52

Cloud Network Networking 52

databricks

JANUARY 27, 2023

“This blog is authored by Hai Nguyen, Senior Data Scientist at Gousto” Gousto is the UK's best value recipe box, serving up more rec.

85

85

Akins IT

JANUARY 25, 2023

According to a recent survey, less than one-third of CEOs (31.8%) said their company is well-prepared for any cybersecurity threat they might face in the foreseeable future, while 58.1% said they are adequately prepared but could be doing more. Common shortcomings typically occur in a number of different areas. 1. Lack of a Comprehensive Plan Organizations may not have a comprehensive plan in place for addressing cybersecurity risks.

Small Business 52

Small Business 52

Dataversity

JANUARY 25, 2023

Over the past few years, enterprise data architectures have evolved significantly to accommodate the changing data requirements of modern businesses. The emergence of advanced data storage technologies, such as cloud computing, data hubs, and data lakes, makes us question the role of traditional data warehouses in modern data architecture. Data warehouses were first introduced in the […] The post Are Data Warehouses Still Relevant?

Cloud 52

Cloud Education 52

Packet Pushers

JANUARY 25, 2023

After setting questions and perspectives on What is Enterprise Architecture, the natural sequence is How to Maintain and Operate an Architecture team. After setting questions and perspectives on What is Enterprise Architecture, the natural sequence is How to Maintain and Operate an Architecture team.

52

52

databricks

JANUARY 25, 2023

This is a collaborative post between Databricks and Matillion. We thank David Willmer, Product Marketing at Matillion, for his contributions. As more and.

77

77

Noction

JANUARY 24, 2023

When it comes to distributed denial-of-service (DDoS) attacks, they are far from a downward trend.

52

52

CATO Networks

JANUARY 24, 2023

Ever since Secure Access Service Edge (SASE) was adopted by every significant networking provider and network security vendor, IT leaders have been waiting for a Gartner SASE Magic Quadrant. And for good reason. The industry has seen widely different approaches to whats being marketed as SASE. Some companies partnered with each other to offer a joint solution with slightly integrated products.

SASE 52

SASE WAN Network Networking 52

Confluent

JANUARY 24, 2023

Confluent’s Stream Governance feature enables a data streaming system that makes real-time data reliable, discoverable, and secure across every part of the business.

Government 52

Government Cloud 52

Packet Pushers

JANUARY 23, 2023

On today's Network Break podcast we cover a raft of Juniper vulnerabilities, whether Cisco should patch serious vulnerabilities in end-of-life products, a big T-Mobile breach, Avaya dealing with significant debt, sweeping rounds of layoffs, and more IT news. On today's Network Break podcast we cover a raft of Juniper vulnerabilities, whether Cisco should patch serious vulnerabilities in end-of-life products, a big T-Mobile breach, Avaya dealing with significant debt, sweeping rounds of layoffs,

Routers 52

Routers Network Networking 52

Noction

JANUARY 23, 2023

How fast BGP converges and how much packet loss occurs during the convergence process depends on four conditions:

52

52

Dataversity

JANUARY 23, 2023

Federated learning is a machine learning technique that allows multiple parties to train a model without sharing their data. It is being used across several industries, from mobile device keyboards to health care to autonomous vehicles to oil rigs. It is particularly useful in situations where data sharing is limited by regulation, or is sensitive or proprietary, […] The post How Federated Learning Is Helping to Overcome Obstacles in Machine Learning appeared first on DATAVERSITY.

Education 52

Education 52

Confluent

JANUARY 24, 2023

reehouse Software and Confluent allow simple, modern data management across applications, databases, data warehouses, or legacy systems without disrupting critical workloads.

Cloud 52

Cloud Application 52

Eventbrite

JANUARY 21, 2023

Wondering how to run a virtual training effectively? If so, you won’t have trouble finding an audience — according to a recent LinkedIn survey, four out of five respondents believe virtual events will remain popular well into the foreseeable future. This means that internet-accessible training events are also here to stay.

Internet 52

Internet 52

Noction

JANUARY 23, 2023

The post Introducing IRP v4.1.1 and the latest BGP Redirect & FlowSpec Redirect threat mitigation mechanisms. appeared first on Noction.

52

52

Dataversity

JANUARY 23, 2023

All enterprise data ends up on storage systems, but if an enterprise storage solution does not have the cyber storage resilience to combat a cyberattack, the C-suite and the IT team are leaving the organization severely exposed. This realization is the trigger for what I see as the number one trend in data storage in 2023: making […] The post Cyber Storage Resilience: How to Impact and Safeguard Data in 2023 appeared first on DATAVERSITY.

Education 52

Education 52