tt
tiny-tokenizer
pypi i tiny-tokenizer
tt

tiny-tokenizer

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

by himkt

3.4.0 (see all)
pypi i tiny-tokenizer
Readme

You tried to install "tiny_tokenizer". The name of tiny_tokenizer renamed to "konoha"

GitHub Stars

162

LAST COMMIT

1yr ago

MAINTAINERS

1

CONTRIBUTORS

11

OPEN ISSUES

0

OPEN PRs

0
VersionTagPublished
3.4.0
2yrs ago
3.3.0
2yrs ago
3.2.0
2yrs ago
3.1.0
3yrs ago
No alternatives found
No tutorials found
Add a tutorial