Observability Pipelines | Datadog

Datadog Observability Pipelines

Adopt your preferred security and data lake solutions with greater flexibility and budget control.

dg/log-pipelines-and-observability-pipelines_hero2

Why Datadog?

Intuitive and Easy to Use

Kickstart your projects today with easy-to-use templates for popular use cases such as dual shipping logs, reducing log volume, and archiving data


Vendor Agnostic

Ensure seamless onboarding of new log data sources and destinations at your own pace, without disrupting your existing workflows or sacrificing visibility


Scalable Sensitive Data Protection

Help protect sensitive data and achieve compliance by redacting it before it leaves your environment with Datadog Sensitive Data Scanner


Out-Of-The-Box Dashboards

Gain comprehensive visibility into the health and performance of all pipelines deployed in your infrastructure from one centralized dashboard, with real-time alerts for important issues


Product Benefits

Reduce Spend with your SIEM tools with Cost-Effective Processing and Routing of All Your Logs

  • Proactively filter your logs before routing, compress their sizes, and ensure critical fields are retained
  • Generate metrics from high-volume logs such as CDN, VPC Flow, Firewall, and Network logs for long-term visibility in a cost-effective way
  • Effectively control your expenses with rule-based quotas or sampling while still capturing critical KPIs and trends
  • Customize log destinations based on priority and needs, routing noisy logs to an archive to streamline your workflow
products/observability-pipelines/feature-1.png

Simplify Migrations and Avoid Vendor Lock-In for More Flexibility and Control

  • Guarantee business continuity throughout the migration process by dual-shipping logs to multiple vendors
  • Ensure seamless onboarding of new log data sources and destinations at your own pace without disrupting your existing workflows or sacrificing visibility
  • Take advantage of best-of-breed solutions with easy routing for different logging use cases
products/observability-pipelines/feature-2.png

Transform and Enrich Logs to Improve Security Insights and Streamline Investigations

  • Transform data into OCSF format on stream before routing to security tools like Amazon Security Lake or other security solutions such as Microsoft Sentinel or Google Chronicle
  • Speed up debugging and reduce log complexity by applying out-of-the-box parsing rules to process and transform over 150 different log types
  • Enhance security and improve data analysis using the GeoIP Parser, which helps you identify an IP address’s geographical location
  • Enrich logs with business-critical data using custom tables to enhance usability for downstream analysis
products/observability-pipelines/feature-4.png

Ensure Compliance and Security Measures Align Perfectly With Your Organization’s Standards

  • Stay compliant with data residency laws and support Data Loss Prevention initiatives with full control over data routing, and enable built-in or user-defined rules to stay compliant with PCI, GDPR, HIPAA, CCPA, and more
  • Protect sensitive data with confidence—credit cards, email addresses, IP addresses—by redacting it before it leaves your environment with Datadog Sensitive Data Scanner
  • Streamline access control and schema standardization by easily adding, copying, and dropping relevant attributes and tags
products/observability-pipelines/feature-3.png

Easily Build, Monitor, and Manage Log Pipelines through a Single Control Plane

  • Kickstart your projects today with easy-to-use templates for popular use cases such as dual shipping logs, reducing log volume, and archiving data
  • Simplify the process of creating, deploying, and managing pipeline instances from anywhere with a user-friendly point-and-click interface
  • Gain comprehensive visibility into the health and performance of all pipelines deployed in your infrastructure from one centralized dashboard, with real-time alerts for important issues
products/observability-pipelines/feature-5.png

Loved & Trusted by Thousands

Washington Post logo 21st Century Fox Home Entertainment logo Peloton logo Samsung logo Comcast logo Nginx logo