# Unable to load tokenizer

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-load-tokenizer%2F140846%3E%5C
**Category:** 🤗Transformers\
**Created:** [February 14, 2025, 12:55pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-load-tokenizer%2F140846 "2025-02-14T12:55:07Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![sai-santhosh](https://avatars.discourse-cdn.com/v4/letter/s/ed655f/32.png) [@sai-santhosh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsai-santhosh)%5C
**Post date:** [February 14, 2025, 12:55pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-load-tokenizer%2F140846%2F1 "2025-02-14T12:55:07Z")

</div>

```from

model = AutoModelForCausalLM.from_pretrained(
    "meta-llama/Llama-3.2-3B",
    quantization_config = bnb_config,
    trust_remote_code = True,
    token = token
).to(device)

tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.2-3B")

```

 ![Screenshot 2025-02-14 182405](https://us1.discourse-cdn.com/hellohellohello/original/3X/b/3/b3b08f3ce4fee4146a87b87a0465c5caa6b967db.png)

im trying to load llama-3.2-3B tokenizer but getting error.

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [February 14, 2025, 1:38pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-load-tokenizer%2F140846%2F2 "2025-02-14T13:38:39Z")

</div>

I don’t know if this is the reason, but you forgot your token.

```py
#tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.2-3B")
tokenizer = AutoTokenizer.from_pretrained("meta-llama/Llama-3.2-3B", token = token)

```

---

<div class="post-metadata">

**Author:** ![sai-santhosh](https://avatars.discourse-cdn.com/v4/letter/s/ed655f/32.png) [@sai-santhosh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsai-santhosh)%5C
**Post date:** [February 14, 2025, 2:40pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-load-tokenizer%2F140846%2F3 "2025-02-14T14:40:17Z")

</div>

Thanks. It worked

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/de4155eb4aa4108ecb32a1389d7cc37ae69f88b7.png) [@system](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsystem)%5C
**Post date:** [February 15, 2025, 2:40am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-load-tokenizer%2F140846%2F4 "2025-02-15T02:40:53Z")

</div>

Closed on February 15, 2025, 2:40am UTC

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.