AWS Bedrock Monitoring | Datadog

AWS Bedrock Monitoring

Monitor Amazon Bedrock metrics and logs with Datadog. Optimize your LLM model usage, determine how users are querying your AI applications, and reduce pain points.

bedrock header

Amazon Bedrock is a fully managed service that offers foundation models (FMs) and other tools for building generative AI applications. Customers can fine-tune their FMs to invoke tasks such as text generation, content creation, and chatbot Q&A — without provisioning or managing any infrastructure.

Datadog’s latest integration with Amazon Bedrock allows you to monitor your Foundation Model usage, track API performance, and document your error rate with runtime metrics and logs. Once installed, Datadog will automatically collect Bedrock metrics and logs. Collecting Bedrock metrics allows you to monitor how frequently your models are used, and discover opportunities to optimize model usage. Datadog can also monitor Bedrock API calls via CloudWatch logs, giving clarity into how customers are using your LLM, and how it responds.

 


Datadogを始める5つのステップ

ステップ1
トライアル登録フォームに入力 わずか30秒で無料でアカウントを作成。クレジットカードは不要
ステップ2
技術スタックに関する基本的な質問に回答 約1分で完了
ステップ3
Datadog エージェントをインストール システムレベルのメトリクスをDatadogプラットフォームに送信
ステップ4
API経由で追加のメトリクスを取得するための認証情報を提供 AWS、Azure、GCPなどのクラウド環境を完全に可視化
ステップ5
すぐに使えるダッシュボードでパフォーマンスを視覚化 環境全体のパフォーマンスをリアルタイムで確認可能

Next-generation AI Monitoring

Monitor and your entire AI and machine learning stack with Datadog.

watchdog-apm-illustration.png

Amazon Bedrock

Monitor your FM usage, API performance, and error rate with runtime metrics and logs.

tracesearch-apm-illustrationv2.png

OpenAI

Monitor token consumption, API performance, and more.

servicemap-apm-illustration.png

NVIDIA DCGM Exporter

Gather metrics from NVIDIA’s discrete GPUs, essential to parallel computing.

Datadog プラットフォームは数多くのお客様に選ばれ、信頼されています

Samsung logo
Ubisoft logo
Deloitte Cloud logo
Cybozuinc logo
sansan logo
Nginx logo
Chef logo
Nasdaq logo
DreamWorks Animation logo
Nikon logo
Zynga logo
Evernote logo
Sonos logo
Monotaroco logo

AI Monitoring Resources

Learn about how Datadog can help you monitor your entire AI stack, from Amazon Bedrock to LLM models.

Datadog AI Monitoring Starter Kit