litellm
v1.108.9The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- Maintenance
- Active16222 commits in 3 months · bus factor 2
- License
- OtherUnknown
- Security
- 19 advisories5 critical, 7 high, 5 medium, 2 low · Scorecard 5.8/10
- Supported versions
- No scheduleendoflife.date does not track this project
63.3k stars · 13.3k forks · 5.2k open issues · last release 18 hours ago · data checked 3 hours ago
Tour
Nobody has run litellm for a tour yet. A tour starts the project in a container, walks through it in a browser and records each step with a screenshot.