niieani

niieani/gpt-tokenizer

The fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4 / GPT-4o / GPT-o1. Port of OpenAI's tiktoken with additional features.

TypeScript
568
40
MIT License
Total donated
Undistributed
Share with your subscribers:

Recipients

How the donated funds are distributed

Support the dependencies of niieani/gpt-tokenizer

Account's avatar
CLI for the swc project
Account's avatar
Super-fast alternative for babel
Account's avatar
TypeScript is a language for application scale JavaScript development
Account's avatar
Next generation testing framework powered by Vite
Account's avatar
Low level bindings for creating Web Standard contexts.

Support the repos that depend on niieani/gpt-tokenizer

Account's avatar
A library of Micro Agents that make it easy to add reliable intelligence to any application.
Account's avatar
SDK focused on building AI based applications for Microsoft Teams.
Account's avatar
GPT Turbo plugin that calculates your conversation size and cost
Account's avatar
A CLI tool to concatenate all text files in your CWD with headers for GPT prompt engineering.
Account's avatar
Openai prompt splitter. Dividing large texts into manageable parts for processing with OpenAI APIs.
Account's avatar
Lobe i18n is a CLI tool that automate translate your i18n localization with AI
Account's avatar
Generate context for an LLM to ask it questions on a project
Account's avatar
Lobe seo is a CLI tool that automate generation seo content for mdx
Account's avatar
CLI tool to analyze and create text dumps of codebases for LLMs
Account's avatar
This CLI tool can help you easily create new web projects, manage existing projects, and automatically make advanced codebase modifications, with more features coming soon.
Account's avatar
Arietta i18n is a CLI tool that automate translate your i18n localization with AI
Account's avatar
A node script that adds 'related posts' information to a set of markdown files.
Account's avatar
translate Markdown into specified multiple languages automatically by openai.
Account's avatar
advanced kodezi command line interface.
Account's avatar
A command-line tool to count tokens in files and folders using GPT-4 tokenization.

Top contributors

niieani's profile
niieani
63 contributions
nickwalton's profile
nickwalton
26 contributions
kafkas's profile
kafkas
8 contributions
mbukeRepo's profile
mbukeRepo
7 contributions
renovate[bot]'s profile
renovate[bot]
4 contributions
InvaderSquibs's profile
InvaderSquibs
3 contributions
andrew-healey's profile
andrew-healey
1 contributions
caleb-artifact's profile
caleb-artifact
1 contributions
schnerd's profile
schnerd
1 contributions
justinsteven's profile
justinsteven
1 contributions

Recent events

Kivach works on the Obyte network, and therefore you can track all donations.

No events yet