LiteLLM
Verified Oct 2, 2026 ActiveOpen-source gateway and Python SDK that put 100+ LLM providers behind one OpenAI-style API, with keys, budgets and spend tracking.
Listed on EffectHub ·
Pricing
- Pricing model
- Freemium
The open-source gateway and SDK are free to self-host with no license fee. Enterprise is sold by annual quote sized to request capacity, deployment and support rather than per token; no dollar figure is published, though a 30-day Enterprise trial key is offered.
Use tool ↗About LiteLLM
LiteLLM has two parts: a Python SDK that calls more than 100 model providers through the OpenAI request format, and a self-hosted gateway (proxy) that gives a whole organisation one endpoint. The gateway issues virtual keys, tracks spend per key, user and team, enforces budgets and rate limits, retries and falls back between deployments, and logs requests. It also fronts MCP servers and agents through the same entry point. The code is MIT-licensed outside an enterprise folder, and a paid Enterprise tier adds SSO, SCIM, audit logs and support. It is developed by Berri AI.
- API
- Yes
- Last verified
- Oct 2, 2026
Verified sources
- Gateway features, provider count and positioninglitellm.ai ↗
- Open-source plan free to self-host, Enterprise priced by annual request capacity, 30-day triallitellm.ai ↗
- SDK and proxy overview, retry and fallback routing, virtual keysdocs.litellm.ai ↗
- MIT licence outside the enterprise directory, copyright Berri AI 2023github.com ↗
- Company profile, San Francisco, YC W23linkedin.com ↗
Is LiteLLM legit?
We don’t label tools safe or unsafe. Below are the records we checked ourselves, each with the date we read it.
- Last checked
- Oct 2, 2026The site answered
- On the market since
- 2023The vendor's own material, read by us
- Operated by
- Berri AI (LiteLLM), United StatesOur research, card verified Oct 2, 2026
Pros & cons of LiteLLM
LiteLLM is the default pick for a platform team that wants one OpenAI-compatible door to many model vendors, with per-team budgets and keys, without paying a hosted router a margin. The SDK is just as useful to a single developer who wants to swap providers with a one-line change. Running the gateway reliably, including its database and scaling, is your job, and the governance features that large companies ask for sit behind the Enterprise licence.
Pros
- One OpenAI-style interface to 100+ providers, in an SDK and a self-hosted proxy
- Virtual keys, spend tracking by key, user and team, budgets and rate limits in the free gateway
- Retry and fallback routing across deployments, plus MCP and agent gateways
- Self-hosted, so traffic and keys stay in your own environment
Cons
- You run and scale the proxy yourself, including its database and upgrades
- SSO, SCIM, audit logs and SLAs require the Enterprise licence, priced only by quote
- The unified format can lag behind provider-specific features on new models
Best for
- Platform teams giving many internal developers governed access to several LLM vendors
- Developers who want to switch or fall back between model providers without rewriting code
- Organisations that must keep prompts and keys inside their own infrastructure
Not for
- Teams that want a fully managed gateway with no servers to operate
- Non-developers looking for a chat app rather than infrastructure
Watch out: The repository is MIT except an enterprise directory under a separate commercial licence, so check which features you rely on before assuming everything is free.
Top alternatives to LiteLLM
LiteLLM head-to-head
Side-by-side fact sheets against the competitors our research or their makers name — pricing, platforms, API and both verdicts on one page.