Amazon Bedrock Monitoring | Datadog

Monitor Amazon Bedrock with Datadog

Track API usage and performance of foundational models that help you build generative AI applications.

dg/bedrock_header

900+ Turn-Key Integrations, Including

Product Benefits

Monitor Your Models' API Performance and Errors

  • Centralize your runtime metrics and logs all in one place after installing the Bedrock integration
  • Visualize the health and performance of your models, including the number of invocations and errors, with Datadog's preconfigured dashboard
  • View real-time statuses of any monitors configured using Bedrock data, such as high number of invocation throttles or inovcation latency
  • Easily compare models' latency and performance against one another to find the top-performing solution that best fits your needs
dg/bedrockbox1.png

Optimize Your Model Usage

  • Monitor how frequently customers are using your AI products most and the complexity of data they typically process and generate
  • Gain insight into optimizing provisioned throughput to balance cost and performance
  • Verify that your models are being used as intended with input and output token count metrics
dg/bedrockbox2.png

Gain Insights into Model Prompts and Responses with Logs

  • Track Bedrock API calls via CloudWatch logs, which is also displayed in Datadog's preconfigured service dashboard
  • Perform deeper analysis into your customers’ queries to identify common trends and how your models respond
  • Analyze log data to determine whether the real-world usage of your model fulfills its intended purpose
  • Understand how to tune your inference parameters for optimizing model performance
logmanagementmarchitectureimage.jpg

Monitor Your Entire AWS Environment More Effectively

  • Easily create intuitive dashboards— no custom query language required
  • Track the health and performance of your AWS infrastructure with out-of-the-box dashboards, including AWS service-specific views for EC2, RDS, ALB, Lambda, and more
  • Receive alerts on essential metrics from AWS services like EC2, Lambda, RDS, and SQS with preconfigured monitors

The Essential Monitoring and Security Platform for the Cloud Age

Datadog brings together end-to-end traces, metrics, and logs to make your applications, infrastructure, and third-party services entirely observable.

Platform Diagram

Loved & Trusted by Thousands

Washington Post logo 21st Century Fox Home Entertainment logo Peloton logo Samsung logo Comcast logo Nginx logo