BlogAI Infrastructure
AI Infrastructure
3 articles on ai infrastructure.
- AI Infrastructure3 min read
Dependency bots tell you what changed. They don't tell you if it matters.
Why we built an LLM-scored, bundle-aware upgrade pipeline instead of accepting the one-PR-per-package model Renovate and Dependabot default to.
- AI Infrastructure3 min read
Building an LLM inference layer that survives any single provider's outage
Why we treat LLM providers as an infrastructure dependency to route around, not a fixed integration — a circuit breaker, a fallback order, and a response layer built for the least standardized provider in the chain.
- AI Infrastructure4 min read
Why your load balancer is wrong about GPUs
Least-connections assumes requests are interchangeable and concurrency degrades gracefully. On a GPU running an LLM, both assumptions are false — and the result is a tail latency nobody can explain.