Use cases
route-switch is a gateway for teams running LLMs in production. These are the situations where a self-hosted, prompt-optimizing gateway earns its keep.
OpenAI-compatible migration
Move an application already built on the OpenAI SDK behind route-switch with a single base-URL change, then unlock routing, analytics, and optimization.
ML & applied-AI engineersPrompt optimization from production traces
Close the loop: capture real traffic, replay it to score MIPROv2 candidates, and ship the winning prompt — automatically, on an interval.
Teams with latency budgetsLatency-aware routing
Use performance-based routing and DuckDB latency data to favor combinations that respond faster, with fallback when a provider slows down.
Teams managing LLM spendCost-aware routing
Bias traffic toward cheaper model combinations with weighted routing, and see per-prompt cost in DuckDB so routing decisions are grounded in real spend.
Platform & reliability engineersMulti-provider failover
Front six providers behind one endpoint, and fall back automatically when a provider combination's success rate drops below its threshold.