5 projects in topic llmops
- litellmBerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
- Version
- v1.108.9
- Stars
- 63.3k
- License
- Other
- Docker
- ghcr.io/berriai/litellm
- langfuselangfuse/langfuse
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
- Version
- v4.80.0
- Stars
- 37.4k
- License
- Other
- Docker
- ghcr.io/langfuse/langfuse
- mlflowmlflow/mlflow
The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
- Version
- v3.18.0
- Stars
- 28.8k
- License
- Apache-2.0
- Docker
- ghcr.io/mlflow/mlflow
- gatewayPortkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
- Version
- v1.15.2
- Stars
- 13.4k
- License
- MIT
- Docker
- –
- phoenixArize-ai/phoenix
AI Observability & Evaluation
- Version
- arize-phoenix-v21.1.0
- Stars
- 12.3k
- License
- Other
- Docker
- –
Page 1 of 1