Understand production LLM behavior with Patterns in Agent Observability

Datadog’s "Patterns" feature automatically clusters LLM production traffic into interpretable, hierarchical topics to reveal unanticipated user behaviors and workflows. By linking these patterns directly to operational metrics like cost, latency, and error rates, the tool helps developers pinpoint the specific drivers of performance regressions. This enables teams to move beyond broad symptoms to build targeted evaluations and datasets based on actual real-world usage.