Running agents across multiple LLM providers (OpenAI-compatible + Google) — free/budget tiers are flaky: rate limits, queues, random errors.
Built a small Docker gateway that benchmarks my model pool and auto-routes/fails over. Looks like one stable model to my apps.
MIT lic 👇
