Open source alternatives to OpenAI API

O

ollamav0.40.16ollama/ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

V

vllmv0.33.0rc3vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

L

LocalAIv4.12.1mudler/LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

L

llama.cppv1.0.0ggml-org/llama.cpp

LLM inference in C/C++