Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
LiteLLM is a Python SDK and AI Gateway that provides a unified interface to call over 100 different LLM APIs in OpenAI-compatible format, with features like cost tracking, guardrails, load balancing, and logging. It's designed for developers and ML platform teams who need to integrate multiple LLM providers into their applications while maintaining consistent API patterns and centralized management of API keys, costs, and performance monitoring.
Recipients
How the donated funds are distributed
Support the dependencies
Support the repos that depend on this repository
Top contributors
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.