Reference

Gateway (coming soon)

The gateway is for teams that cannot change code, use a language without an SDK, or want limits that stop calls.

How it will work

You run the Zexl gateway, an open-source LiteLLM proxy with a Zexl plug-in, in your own cloud. Your apps change one base URL to point at it. It forwards calls to your providers with your own keys, and sends Zexl the same metadata the SDK sends. Prompts stay in your network.

text
Your app ──▶ Zexl gateway (in your cloud) ──▶ OpenAI, Anthropic, Bedrock, …
                  └──▶ call metadata only ──▶ Zexl

What it adds

GatewaySDK
Spend, waste patterns, forecastYesYes
Any language, no code changeYesPython only
More than 100 providersYesOpenAI and Anthropic
Stop a call (budget limit, max cost per run, allowed models)Yes, off by defaultNo, alerts only
Retries, fallbacks, cachingYesNo
Extra network hopA few millisecondsNone

Labels come from request headers (x-zexl-feature, x-zexl-run, x-zexl-customer) or from the gateway key's name.

Want it early? Tell us which providers and limits you need.