Skip to content

Latest commit

 

History

History
2 lines (2 loc) · 143 Bytes

README.md

File metadata and controls

2 lines (2 loc) · 143 Bytes

hf-bert-tokenizer

A bert tokenizer implementting by Java, especially for Chinese, dedicated to compatibility with huggingface bert tokenizer