Javascript BPE Encoder Decoder for GPT-2 / GPT-3
JavaScript
724
195
MIT License
This project provides a JavaScript implementation of the Byte Pair Encoding (BPE) encoder and decoder used by GPT-2 and GPT-3 models, allowing developers to convert text to and from the integer token format these models use. It's designed for JavaScript developers working with GPT-2/3 models who need to preprocess text data or interpret model outputs, and is compatible with Node.js version 12 and above.
Total donated
Undistributed
Share with your subscribers:
Recipients
How the donated funds are distributed
Support the dependencies
Support the repos that depend on this repository
Top contributors
nickwalton
26 contributions
kafkas
8 contributions
InvaderSquibs
3 contributions
andrew-healey
1 contributions
caleb-artifact
1 contributions
schnerd
1 contributions
parzival418
1 contributions
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
No events yet
