arabovs-ai-lab
/

TatarTokenizers

language-modeling

Model card Files Files and versions

TatarTokenizers / wordpiece

214 kB

1 contributor

History: 3 commits

ArabovMK's picture

Upload wordpiece/tokenizer_config.json with huggingface_hub

164f443 verified about 2 months ago

special_tokens_map.json

132 Bytes

Upload wordpiece/special_tokens_map.json with huggingface_hub about 2 months ago
tokenizer.json

213 kB

Upload wordpiece/tokenizer.json with huggingface_hub about 2 months ago
tokenizer_config.json

1.22 kB

Upload wordpiece/tokenizer_config.json with huggingface_hub about 2 months ago