Tokenizr is a JavaScript/TypeScript library for string tokenization, designed to serve as a lexical scanner in recursive descent parsers. It supports efficient iteration, stacked states, regular expression matching, and features like match repeating, rejecting, and ignoring, along with token look-ahead and nested transactions. This library is ideal for developers building parsers or processing structured text in JavaScript or TypeScript environments.