Datadog APM is here

Spark

BIG DATACLUSTERSRESOURCE MANAGEMENT

Retrieve resource and performance metrics from YARN’s ResourceManager with Datadog. With Spark + Hadoop YARN, you’ll be able to split “big data” jobs into smaller jobs that run in parallel. Datadog gives you the tools to visualize the performance of your Spark jobs.