litellm

v1.108.9

BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Compare View on GitHub

Maintenance: Active16222 commits in 3 months · bus factor 2
License: OtherUnknown
Security: 19 advisories5 critical, 7 high, 5 medium, 2 low · Scorecard 5.8/10
Supported versions: No scheduleendoflife.date does not track this project

63.3k stars · 13.3k forks · 5.2k open issues · last release 18 hours ago · data checked 4 hours ago

Overview Tour Releases Docker images Security Logos

Breaking changes

What to check before upgrading, taken from the notes of the last 30 releases.

v1.108.0Nov 4, 2026
- refactor(utils)!: delete prompt_token_calculator by @ryan-crabbe-berri in https://github.com/BerriAI/litellm/pull/38132
- fix(cerebras)!: add max_retries and extra_headers to get_supported_openai_params by @deepanshululla in https://github.com/BerriAI/litellm/pull/36601

Release history

All releases on GitHub

Atom feed/feed/BerriAI/litellm

Badge

[![version](/badge/BerriAI/litellm)](/p/BerriAI/litellm)

> [!WARNING]

> This release was only partly published. Use v1.111.0-dev.4 instead.

> It is built from the same commit and fixes the publishing problems below.

> [!IMPORTANT]

> Signing has moved to keyless cosign. This is the first release signed with Sigstore keyless signing (GitHub OIDC) instead of the cosign.pub key.

> cosign verify --key ... does not work for this release or later ones. Use the command below. Earlier releases still verify with the key.

Known issues, fixed in v1.111.0-dev.4

pip install "litellm[proxy]==1.111.0.dev3" failed at first, because the litellm-proxy-extras and litellm-enterprise versions it pins were not on PyPI yet. They are published now, so the install works
The enterprise package repository is missing the litellm sdist and the litellm-proxy wheels for this version

The Docker image, Helm chart and PyPI wheels of this release are otherwise the same code as v1.111.0-dev.4. See its notes for what changed

Verify this release

cosign verify \
  --certificate-identity https://github.com/BerriAI/project-releaser/.github/workflows/release.yml@refs/heads/main \
  --certificate-oidc-issuer https://token.actions.githubusercontent.com \
  ghcr.io/berriai/litellm:v1.111.0-dev.3

Full release notes Compare with previous