Shipping reliable tool-calls at scale
How we cut tool-call failures by 9× with typed schemas and retries.
Engineering
How we cut agent inference latency to 82ms
A look inside the scheduling, caching, and routing work that took our median agent response time below the 100ms threshold — and what it unlocks for real-time products.
Mira Chen · 8 min read
