Large-scale LLM inference engine
0
0
GNU Affero General Public License v3.0
Aphrodite Engine is a high-performance inference engine for serving large language models at scale, built on vLLM's PagedAttention technology. It provides optimized, continuous batching and supports extensive quantization methods for efficient
Total donated
Undistributed
Share with your subscribers:
Recipients
How the donated funds are distributed
Support the dependencies
Support the repos that depend on this repository
Top contributors
AlpinDale
1431 contributions
50h100a
56 contributions
StefanGliga
20 contributions
g4rg
9 contributions
ahme-dev
8 contributions
WolframRavenwolf
4 contributions
sgsdxzy
4 contributions
TearGosling
3 contributions
Pyroserenus
3 contributions
Naomiusearch
3 contributions
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
No events yet