# the entire integration:$ export OPENAI_BASE_URL=https://gateway.valite.ai/openai/v1
Your inference bill is provably too high.
valite is a drop-in gateway that fingerprints every LLM call into callsites, replays your real traffic offline to prove cheaper models at iso-quality, then promotes the winners live behind shadow, canary, and automatic rollback.
no code changes · one base_url · remove it any time
demo one of your callsites, routed with proof
each callsite is replayed on many models offline — the cheapest one that holds quality takes over
⌂ self-hosted — open models valite hosts for you · illustrative
Built by researchers and engineers from
- OpenAI
- Harvard
integration
One line. That's the whole integration.
Point your OpenAI or Anthropic SDK at valite. Requests pass through unchanged, responses stream straight back, and every call gets fingerprinted into a callsite. Your API keys are never stored. Delete the line and we're gone.
client = OpenAI(- base_url="https://api.openai.com/v1",+▊)
# that's the integration. all of it.
pillar 01 · offline
Find cheaper models. Prove it before it ever touches prod.
The optimization harness replays your recorded production traffic against cheaper candidate models — offline, completely off the hot path. Every callsite gets an objective quality score against your current baseline, so you see exactly which callsites are over-provisioned, with evidence, while production runs untouched. No performance regression, by construction: a candidate that loses quality never leaves the harness.
| callsite | running on | candidate | Δ cost | Δ quality | verdict |
|---|---|---|---|---|---|
| triage.classify | gpt-5 | gpt-5-mini | −87% | +0.2% | PROVEN |
| extract.entities | gpt-5 | gpt-5-mini | −83% | −0.1% | PROVEN |
| summarize_thread | claude-sonnet-5 | claude-haiku-4-5 | −76% | −0.3% | PROVEN |
| agent.plan | gpt-5 | gpt-5-mini | −85% | −6.4% | REJECTED |
replayed on 12,406 real production requests · numbers illustrative
pillar 02 · live
Then ship it like you don't trust us.
Proven candidates go live gradually: shadow traffic first, then a canary slice, then full promotion. An error-rate tripwire watches every routed call and pulls routing the moment failures spike above baseline — plus a kill switch that stops all routing instantly, no restart. You find out from the changelog, not the incident channel.
— illustrative
Frequently asked questions
Everything you need to know about valite.
waitlist
We'll find your over-provisioned callsites.
Early access rolls out in order. Join the waitlist and we'll run the harness on your traffic first — you keep the report either way.