Operating agentic AI with Amazon Bedrock AgentCore and Datadog LLM Observability: Lessons from NTT DATA

NTT DATA tackled the challenge of deploying dependable agentic AI systems in production by combining Amazon Bedrock AgentCore and Datadog LLM Observability. They found that while building a proof-of-concept is relatively easy, ensuring security, visibility, and consistent behavior requires a standardized execution platform like AgentCore. Crucially, they needed observability beyond traditional metrics – Datadog’s LLM Observability allowed them to track the reasoning behind agent decisions and integrate evaluation criteria directly into their operational workflows for continuous improvement.