cpiprint/tensorzero

TensorZero is an open-source stack for building industrial-grade LLM applications, providing a unified gateway for accessing multiple LLM providers, observability tools, optimization capabilities, evaluation frameworks, and experimentation features. It's designed for developers and organizations building production LLM applications who need low-latency performance, comprehensive monitoring, and the ability to optimize models and prompts based on real-world usage data.