vllm
v0.33.0rc3A high-throughput and memory-efficient inference and serving engine for LLMs
- Maintenance
- Active11334 commits in 3 months · bus factor 14
- License
- Apache-2.0Permissive · OSI-approved
- Security
- 30 advisories7 high, 22 medium, 1 low
- Supported versions
- No scheduleendoflife.date does not track this project
97k stars · 24.8k forks · 10.4k open issues · last release 13 days ago · data checked 3 hours ago
Logos
This is the avatar of the vllm-project account on GitHub. The mark belongs to its owner; check their brand guidelines before you publish it. Project website