litellm
v1.108.9The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- Maintenance
- Active16222 commits in 3 months · bus factor 2
- License
- OtherUnknown
- Security
- 19 advisories5 critical, 7 high, 5 medium, 2 low · Scorecard 5.8/10
- Supported versions
- No scheduleendoflife.date does not track this project
63.3k stars · 13.3k forks · 5.2k open issues · last release 16 hours ago · data checked 2 hours ago
Logos
This is the avatar of the BerriAI account on GitHub. The mark belongs to its owner; check their brand guidelines before you publish it. Project website