litellm
v1.108.9The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- Maintenance
- Active16222 commits in 3 months · bus factor 2
- License
- OtherUnknown
- Security
- 19 advisories5 critical, 7 high, 5 medium, 2 low · Scorecard 5.8/10
- Supported versions
- No scheduleendoflife.date does not track this project
63.3k stars · 13.3k forks · 5.2k open issues · last release 15 hours ago · data checked 1 hour ago
Docker images
- Image
- ghcr.io/berriai/litellm
- Registries
- GHCR
- Docker Hub pulls
- –
docker pull ghcr.io/berriai/litellm:latestTagArchitecturesSizePushed
latest———
main-v1.66.0-stable———
main-v1.66.0-nightly———
main-v1.65.8-nightly———
main-v1.65.7-nightly———
main-v1.65.6-nightly———
main-v1.65.5-nightly———
main-v1.65.4-stable———
main-v1.65.4-nightly———
main-v1.65.3-nightly.post1———
main-v1.65.3-nightly———
main-v1.65.2.dev1———
main-v1.65.1-nightly———
main-v1.65.0.rc———
main-v1.65.0-stable———
main-v1.65.0-nightly———
main-v1.64.1-nightly———
main-v1.63.14.rc———
main-v1.63.14-stable.patch1———
main-v1.63.14-stable———
main-v1.63.14-nightly———
main-v1.63.12-nightly———
main-v1.63.11-stable.patch1———
main-v1.63.11-stable———
main-v1.63.11-nightly———