Tokenizes sentences containing a mix of Chinese and English words.
JavaScript
5
2
The Unlicense
Total donated
Undistributed
Share with your subscribers:
Recipients
How the donated funds are distributed
Support the dependencies of catcher-in-the-try/mixed-english-and-chinese-tokenizer
test framework agnostic BDD-style assertions
Checks whether the input string contains any Chinese text (at least one character). Works with Traditional and Simplified. Unlike the is-chinese package, returns `true` even if the string contains mixed Chinese and non-Chinese characters.
Wordnet Lemmer
Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.
Top contributors
anton-bot
5 contributions
Recent events
Kivach works on the Obyte network, and therefore you can track all donations.
No events yet