BerriAI/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

38,193 stars6,247 forksPythonView on GitHub ↗
7-day Growth RateA+
+21/day
Top 2.6%

Daily compound star growth rate over 7 days

30-day Growth RateA+
+1/day
Top 2.6%

Daily compound star growth rate over 30 days

AccelerationS
Steady
Top 0.0%

Is the growth rate speeding up or slowing down?

OriginalityD
2/100
Top 69.1%

Stars earned relative to the number of similar repos in the same category

Topics

ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyvertex-ai

Data as of 2026-03-08