# Finetune fill-mask network

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-fill-mask-network%2F19371%3E%5C
**Category:** Models\
**Created:** [June 20, 2022, 9:42am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-fill-mask-network%2F19371 "2022-06-20T09:42:23Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![GenV](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/genv/32/12132_2.png) [@GenV](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FGenV)%5C
**Post date:** [June 20, 2022, 9:42am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffinetune-fill-mask-network%2F19371%2F1 "2022-06-20T09:42:23Z")

</div>

Hello,  
I’m trying to finetune a xlm-roberta-base for a multilingual fill-mask task.

Is there any code (for example in [this](https://github.com/huggingface/transformers/tree/main/examples/pytorch) repo) that I can refer to?

Is there a better network than xlm-roberta-base for a finetuning fille-mask task (as a T5 model) ?

Thanks.