# Error finetuning XLM-RoBERTa-Large when training

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-finetuning-xlm-roberta-large-when-training%2F20412%3E%5C
**Category:** 🤗Tokenizers\
**Created:** [July 15, 2022, 9:03am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-finetuning-xlm-roberta-large-when-training%2F20412 "2022-07-15T09:03:10Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![JeunesseAfricaine](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jeunesseafricaine/32/5381_2.png) [@JeunesseAfricaine](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJeunesseAfricaine)%5C
**Post date:** [July 15, 2022, 9:03am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-finetuning-xlm-roberta-large-when-training%2F20412%2F1 "2022-07-15T09:03:10Z")

</div>

I followed the guide on the documentation [HERE](https://huggingface.co/docs/transformers/v4.20.1/en/training) while pre-training a zero-shot classifier. These are screenshots of Tokenization, Compute Metrics, Training Arguments, and Trainer.

 ![Screen Shot 2022-07-15 at 11.57.57 AM](https://us1.discourse-cdn.com/hellohellohello/original/2X/5/57f2121cf0348545544f62266d7c8d3b933757f7.png)

---

<div class="post-metadata">

**Author:** ![JeunesseAfricaine](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jeunesseafricaine/32/5381_2.png) [@JeunesseAfricaine](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJeunesseAfricaine)%5C
**Post date:** [July 15, 2022, 9:07am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-finetuning-xlm-roberta-large-when-training%2F20412%2F2 "2022-07-15T09:07:03Z")

</div>

![Screen Shot 2022-07-15 at 11.57.34 AM](https://us1.discourse-cdn.com/hellohellohello/original/2X/d/d8d13206a042360279e072a5aa77a01528158d96.png)

---

<div class="post-metadata">

**Author:** ![JeunesseAfricaine](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/jeunesseafricaine/32/5381_2.png) [@JeunesseAfricaine](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJeunesseAfricaine)%5C
**Post date:** [July 15, 2022, 9:07am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ferror-finetuning-xlm-roberta-large-when-training%2F20412%2F3 "2022-07-15T09:07:34Z")

</div>

![Screen Shot 2022-07-15 at 11.57.00 AM](https://us1.discourse-cdn.com/hellohellohello/original/2X/e/e35ac491c62d3763ad999883384d8994b041d368.png)