Models

novateur/WavTokenizer

Text-to-Speech • Updated Dec 2, 2024 • 54

ibm-research/DAC.speech.v1.0

Updated Sep 19, 2024 • 25 • 14

pszemraj/sail-slimpajama-6B-32768-BPE-tokenizer

Updated Oct 6, 2024

gpwr/bark-it-tokenizer

Updated Nov 9, 2024

charanhu/kannada-tokenizer

Text Generation • Updated Nov 12, 2024 • 2

GlowCheese/minBERT

Text Classification • Updated Dec 4, 2024 • 1

AhmetSemih/tr_tokenizer

Updated Dec 26, 2024

aliarda/turkish_tokenizer

Updated Dec 3, 2024 • 1

aliarda/turkish_tokenizer_256k

Updated Dec 4, 2024 • 1

tejagowda/t5-hebrew-translation

Text Classification • 0.2B • Updated Dec 7, 2024 • 17

aloobun/IN-Llama-3-Tokenizer

Updated Mar 7

clearloop/tokenizer

Updated Jan 7

Saiteja/telugu-bpe

Updated Jan 5 • 4

aayushraina/hindi-bpe-tokenizer

Text Generation • Updated Jan 11

aayushraina/bpe-hindi

Text Generation • Updated Jan 11

InterwebAlchemy/PGNTokenizer

Updated Feb 11 • 1

sachin6624/sachin-gpt2-tokenizer

Updated Feb 3 • 1

Ornaments/72k-Bilingual-BBPE-TK-SPM-Identity

Updated Feb 18

Ornaments/72k-TK-BBPE-HF

Updated Feb 18

savath/laonlp-enhanced

Updated Feb 21

mishmish66/throwing_fast

Robotics • Updated Feb 28

Adiii143/code-search-net-tokenizer

Updated Mar 12

TuKoResearch/WavCochV8192

Feature Extraction • 11.1M • Updated Aug 19 • 21

mishmish66/trying-fast

Robotics • Updated Apr 22

deshanksuman/romanized-sinhala-tokenizer

Updated Sep 14

Namuun123/mn_sentencepiece_tokenizer

Updated Apr 25

luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_150k_20ep

2.17M • Updated May 9 • 7

luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_400k_30ep

2.17M • Updated May 9 • 8

ArabovMK/tajik-tokenizers-v1

Updated May 10

neghny/segmo

Updated May 15