Collect Google Stackdriver logs with Datadog
Google Cloud’s Stackdriver Logging is a managed service that centralizes and stores logs from your Google Cloud Platform services and applications. We are excited to announce that Datadog’s GCP integration now includes Stackdriver Logging. You can collect all your GCP logs using Datadog so you can search, filter, analyze, and alert on them along with your metrics and distributed request traces in a single platform.
With Stackdriver Logging, you can export logs to specified endpoints, or sinks, by creating a filter in Stackdriver to select the logs you want to export and defining a valid endpoint. You can now add Datadog as a sink for Stackdriver logs and configure the exporter to use a Cloud Pub/Sub as a queue that automatically forwards the relevant logs to Datadog.
Stackdriver logs are JSON formatted, which means that out of the box Datadog can parse and use meaningful information from any log it ingests from Stackdriver. Datadog will automatically parse attributes from JSON-formatted logs and attach resource labels as tags, which enable you to filter and sort your logs to focus on the data that matters most to you.
You can use the attributes that Datadog pulls from JSON logs to create facets, which you can easily use to group and analyze your logs to quickly surface problems. For example, group your logs by the URL path to surface latency problems on particular endpoints.
Monitor your entire GCP infrastructure
The ability to collect Stackdriver logs, combined with Datadog’s numerous GCP integrations and distributed tracing, delivers even greater visibility into your Google Cloud infrastructure and applications in a single pane of glass.
You can now monitor, visualize, and alert on your Stackdriver logs alongside platform metrics and application performance data for end-to-end coverage of your GCP environment. With tags, you can easily pivot from GCP metrics to relevant logs, giving you greater insight into your infrastructure.
Start collecting Stackdriver logs
If you already use Datadog to monitor your GCP services, you can begin collecting Stackdriver logs right away. See our documentation for steps on how to create a Pub/Sub exporter and add a verified endpoint to start viewing logs in Datadog. If you’re not yet using Datadog, sign up for a free 14-day trial.