AWS Bedrock Monitoring

Monitor Amazon Bedrock metrics and logs with Datadog. Optimize your LLM model usage, determine how users are querying your AI applications, and reduce pain points.

Amazon Bedrock is a fully managed service that offers foundation models (FMs) and other tools for building generative AI applications. Customers can fine-tune their FMs to invoke tasks such as text generation, content creation, and chatbot Q&A — without provisioning or managing any infrastructure.

Datadog’s latest integration with Amazon Bedrock allows you to monitor your Foundation Model usage, track API performance, and document your error rate with runtime metrics and logs. Once installed, Datadog will automatically collect Bedrock metrics and logs. Collecting Bedrock metrics allows you to monitor how frequently your models are used, and discover opportunities to optimize model usage. Datadog can also monitor Bedrock API calls via CloudWatch logs, giving clarity into how customers are using your LLM, and how it responds.