Datadog Releases Data Streams Monitoring to Assess Streaming Data Pipeline Performance | Datadog

Datadog Releases Data Streams Monitoring to Assess Streaming Data Pipeline Performance

Data Streams Monitoring helps organizations measure and meet strict SLAs and avoid critical downtime by observing queue health, consumer lag and end-to-end latency in event-driven applications like those using Kafka and RabbitMQ

Data Streams Monitoring helps organizations measure and meet strict SLAs and avoid critical downtime by observing queue health, consumer lag and end-to-end latency in event-driven applications like those using Kafka and RabbitMQ

April 27, 2023

8:05 PM UTC

Published by PR Newswire

contact

NEW YORKDatadog, Inc. (NASDAQ: DDOG), the monitoring and security platform for cloud applications, today announced the general availability of Data Streams Monitoring, which makes it simple for organizations to track and manage the performance of applications that rely on messaging systems like RabbitMQ. Data Streams Monitoring automatically visualizes all interdependencies and key health metrics across all streaming data pipelines to help organizations prevent and troubleshoot latency and downtime.

Traditional solutions often provide only a limited view of streaming data pipelines and struggle to consistently identify the root causes of issues, such as drops in throughput or failing services. They may also lack context from upstream and downstream dependencies. This means internal teams must devote more time to manual tasks and troubleshooting in order to gather relevant information, analyze it contextually and determine the necessary collaborative efforts with other teams.

Streaming pipelines lie at the heart of numerous mission-critical applications, including banking and trading technologies, automotive systems, payment platforms and video infrastructures. Teams responsible for managing these streaming pipelines require precise measurement of end-to-end request latencies as they are frequently governed by service-level agreements (SLAs) and regulatory restrictions.

As part of Datadog’s APM platform, Datadog Data Streams Monitoring automatically visualizes interdependencies and key health metrics across all streaming data pipelines. With Data Streams Monitoring, engineers can measure latency between any two points across an entire streaming data pipeline, locate faulty queues or services and mitigate floods of backed-up messages so they can avoid critical downtime.

“Building streaming data pipelines to power our digital trading platform requires visibility into throughput and latency across the entire system, including all queues and services,” said Darren Furr, Solutions Architect at MarketAxess. “With Data Streams Monitoring, our team is able to proactively discover performance bottlenecks and optimize stream processing to ensure maximum throughput and low latency delivery of data to our customers.”

“Kafka has become a key component in powering our data processing infrastructure and gaming data streams, which are built using highly sophisticated architectures,” said SeungYong Oh, VP of Engineering at Devsisters. “Datadog Data Streams Monitoring allows us to easily map the topology of our Kafka pipelines across our globally spread clusters, monitor end-to-end latency and identify sources of incidents across our entire pipeline in one place. Having Data Streams Monitoring integrate seamlessly with APM helps us ensure that millions of gamers around the world always get the best possible experience.”

“There is a gap in visibility between SREs and application developers today, which limits their understanding of how queues are impacting mission-critical services and end-to-end latency of high-value user experiences like the resolution of banking transactions, the generation of shopping recommendations or payment processing,” said Omri Sass, Group Product Manager at Datadog. “While existing solutions can only observe individual queues and services, Data Streams Monitoring provides visibility into an organization’s entire ecosystem to make troubleshooting quicker and easier.”

Data Streams Monitoring is now generally available for Kafka and RabbitMQ, with support for more technologies coming soon. Pricing starts at $35 per host per month when purchased with Datadog APM. To learn more, please visit: https://www.datadoghq.com/blog/data-streams-monitoring/

About Datadog

Datadog is the observability and security platform for cloud applications. Our SaaS platform integrates and automates infrastructure monitoring, application performance monitoring, log management, real-user monitoring, and many other capabilities to provide unified, real-time observability and security for our customers’ entire technology stack. Datadog is used by organizations of all sizes and across a wide range of industries to enable digital transformation and cloud migration, drive collaboration among development, operations, security and business teams, accelerate time to market for applications, reduce time to problem resolution, secure applications and infrastructure, understand user behavior, and track key business metrics.

Forward-Looking Statements

This press release may include certain “forward-looking statements” within the meaning of Section 27A of the Securities Act of 1933, as amended, or the Securities Act, and Section 21E of the Securities Exchange Act of 1934, as amended including statements on the benefits of new products and features. These forward-looking statements reflect our current views about our plans, intentions, expectations, strategies and prospects, which are based on the information currently available to us and on assumptions we have made. Actual results may differ materially from those described in the forward-looking statements and are subject to a variety of assumptions, uncertainties, risks and factors that are beyond our control, including those risks detailed under the caption “Risk Factors” and elsewhere in our Securities and Exchange Commission filings and reports, including the Quarterly Report on Form 10-Q filed with the Securities and Exchange Commission on November 4, 2022, as well as future filings and reports by us. Except as required by law, we undertake no duty or obligation to update any forward-looking statements contained in this release as a result of new information, future events, changes in expectations or otherwise.