Production-grade OpenAI-compatible LLM gateway with verified types, effect tracking, and cryptographic discharge proofs
0
0
MIT License
Straylight-LLM is a production-grade Haskell gateway that provides an OpenAI-compatible API for routing LLM requests through multiple providers with automatic failover, circuit breakers, and cryptographic discharge proofs. It features formal verification with 904 lines of Lean4 proofs, effect tracking using graded monads, and io_uring backend for 5x throughput, making it ideal for teams requiring verifiable security guarantees and maximum performance for their AI infrastructure.
Total donated
Undistributed
Share with your subscribers:
Recipients
How the donated funds are distributed
Support the dependencies
Support the repos that depend on this repository
Top contributors
justinfleek
51 contributions
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
No events yet