n24q02m/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Other

LiteLLM is a Python SDK and AI Gateway that provides a unified OpenAI-compatible interface to call 100+ LLM providers (e.g., OpenAI, Anthropic, Azure, Vertex AI) with features like cost tracking, load balancing, and guardrails. It's designed for developers and ML/platform teams building AI applications, offering both

Total donated

Undistributed

Share with your subscribers: