20× the CI traffic without getting slower: How we rebuilt Git serving at Datadog

To handle the massive Git traffic and high CPU load caused by large monorepos and AI coding agents, Datadog developed "gitretriever," a decentralized system of independent Git mirrors. By replacing a resource-intensive replicated architecture with independent pods that serve local copies without the overhead of consensus, the company successfully distributed the computational burden of packfile construction. This approach has allowed the system to maintain low latency even while managing 20x traffic growth.