nursimakgul
/

backend-bpe-tokenizer

Model card Files Files and versions

backend-bpe-tokenizer

329 kB

1 contributor

History: 18 commits

nursimakgul's picture

Upload tokenizer.json with huggingface_hub

a1a1354 verified 5 months ago

.gitattributes
1.52 kB

initial commit 5 months ago
backend_tokenizer.model
264 kB
xet

Upload backend_tokenizer.model with huggingface_hub 5 months ago
backend_tokenizer.vocab
21.3 kB

Upload backend_tokenizer.vocab with huggingface_hub 5 months ago
config.json
62 Bytes

Upload config.json with huggingface_hub 5 months ago
special_tokens_map.json
95 Bytes

Upload special_tokens_map.json with huggingface_hub 5 months ago
tokenizer.json
41.7 kB

Upload tokenizer.json with huggingface_hub 5 months ago
tokenizer_config.json
682 Bytes

Upload tokenizer_config.json with huggingface_hub 5 months ago