litellm is by BerriAI — not by us.
We indexed this project so people can find it. We are not selling it, we host no copy of the code, and we are not affiliated with or endorsed by its authors — get it from them.
The core of this project is MIT-licensed (detected from the license text; GitHub could not classify it automatically) and free to use. A separate portion is commercially licensed by the publisher — from the upstream license: "Portions of this software are licensed as follows". Read the upstream LICENSE before relying on any enterprise feature.
We flag this because a repository page rarely makes the boundary obvious — you often find out which features are paid only after building on them.
Indexed Aug 1, 2026 · 55,207 stars at index time. Maintainers: claiming verifies your identity and unlocks a higher assurance tier. Removal requests are honored.
Component · for humans & their agents
litellm
unclaimed listingactively maintainedFree coreMIT
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tra
by Open Source Community · New publisher
Every claim on this page is refundable if it is untrue — refund policy.
☆ Save**BerriAI/litellm** is an open-source project by BerriAI: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]. Indexed here so it can be found — not resold.
It is free. Get it from the upstream repository: https://github.com/BerriAI/litellm
From the project's own README (excerpt, reproduced for discovery under its null license):
🚅 LiteLLM LiteLLM AI Gateway Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format. LiteLLM Proxy Server (AI Gateway) Hosted Proxy Enterprise Tier Website
---
What is LiteLLM
LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format.
Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization.
Jump to LiteLLM Proxy (LLM Gateway) Docs Jump to Supported LLM Providers
---
Why LiteLLM
Managing LLM calls across providers gets complicated fast — different SDKs, auth patterns, request formats, and error types for every model. LiteLLM removes that friction: • Unified API — one interface for 100+ LLMs, no provider-specific SDK juggling • Drop-in OpenAI compatibility — swap providers without rewriting your code • Production-ready gateway — virtual keys, spend tracking, guardrails, load balancing, and an admin dashboard out of the box • 8ms P95 latency at 1k RPS (benchmarks)
OSS Adopters
Netflix
---
Features
LLMs - Call 100+ LLMs (Python SDK + AI Gateway)
All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.
Python SDK
AI Gateway (Proxy Server)
Getting Started - E2E Tutorial - Setup virtual keys, make your first request
Docs: LLM Providers
Agents - Invoke A2A Agents (Python SDK + AI Gateway)
Supported Providers - LangGraph, Vertex AI Agent Engine, Azure AI Foundry, Bedrock AgentCore, Pydantic AI
Python…
Preview
See what it does before you commit. Previews show behavior, never source code.
01Capabilities
Does
- + Model usage tracking
- + Cost attribution
- + Model-routing visibility
- + LLM cost alerting
- + Rate limits
- + Usage metering
- + Budget policies & spending limits
- + Programmatic API
- + MCP integrations
- + Audit logs
- + Authentication
- + Role-based access control
Doesn’t
- No exclusions declared
02Requirements & stack
Depends on
- → PostgreSQL database
- → Authentication
Credentials needed
None declared
Stack
03Community
No endorsements yetNo verified confirmations yet — be the first.
Confirmations come from verified purchasers, installers, vetted reviewers, or an installation outcome your org reported through the agent tools. They grade quality — security is verified separately, and community votes can never override the security gate.
Sign in to confirm — weight comes from verified usage, not vote count.
04Trust Passport
Full passport →0/0 automated components pass. An automated score is never a security guarantee.
This listing is unclaimed, so publisher identity cannot be verified and it stays below the “verified” tier by design — that is a statement about the listing, not about the project’s quality. Our automated scans still ran; a maintainer who claims it unlocks identity verification.
- publisher identity Publisher status verified; 0 verification(s) on file
- malicious pattern scan No known malicious-behavior patterns detected in reviewed content
- capability contract All 0 observed capability reference(s) match the declared manifest
- agent safety scan No injection patterns in agent-readable content
- provenance No release signature or provenance attestation
- behavioral sandbox Not performed in this environment — requires the production isolated runner (docs/sandbox-requirements.md). No untrusted code is ever executed on the application host.
Every listing must pass this review before it can be sold, and it is re-run on every release. Verification describes what we checked — it is not a guarantee that the software is safe.
05Versions
Full history →| Version | Channel | Released | Notes |
|---|---|---|---|
| 0.0.0 | stable | Aug 1, 2026 | Indexed listing — see the upstream repository for real release history. |