Datadog customers today can use Data Jobs Monitoring (now GA) to optimize performance and efficiency of Spark based pipelines that use e.g. Databricks or EMR, and Data Streams Monitoring (also GA) to better understand and measure performance on streaming data pipelines that use e.g. Kafka or SQS, end to end. And, Datadog continues to hear from customers about more challenges with data and data pipelines.
We are looking to hear more from our customers about what challenges they’d like help with most, and we are seeking design partners to test current Preview efforts that:
We’ll reach out soon with next steps. In the meantime, feel free to reach out to your CSM with any questions.