Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
TypeScript
2150
211
MIT License
node-llama-cpp provides Node.js bindings for llama.cpp, enabling developers to run large language models locally on their machines. This TypeScript-supported library offers GPU acceleration, JSON schema enforcement, and function calling capabilities, making it ideal for developers building AI-powered applications who want local model deployment without relying on cloud APIs.
How the donated funds are distributed
Kivach works on the Obyte network, and therefore you can track all donations.
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
