# Fine tunning Spanish BERT model
**URL:**
**Author:**  [@Armando](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FArmando)%5C
**Post date:** [February 2, 2021, 8:52pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-spanish-bert-model%2F3482%2F1 "2021-02-02T20:52:50Z")
Hi,
how can I fine-tune the spanish BERT model:
> **[dccuchile/bert-base-spanish-wwm-cased · Hugging Face](https://huggingface.co/dccuchile/bert-base-spanish-wwm-cased)**
---
**Author:**  [@VP1](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FVP1)%5C
**Post date:** [February 3, 2021, 10:51am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-spanish-bert-model%2F3482%2F2 "2021-02-03T10:51:15Z")
Do you want to fine-tune it for a specific task or with more text data?
---
**Author:**  [@Armando](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FArmando)%5C
**Post date:** [February 3, 2021, 2:17pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-spanish-bert-model%2F3482%2F3 "2021-02-03T14:17:42Z")
Hi,
I want to fine tune with my own text data.
---
**Author:**  [@lewtun](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Flewtun)%5C
**Post date:** [February 3, 2021, 3:53pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-spanish-bert-model%2F3482%2F4 "2021-02-03T15:53:23Z")
Which task in particular (classification, question answering, etc)? There’s quite a few examples here that you could adapt to your corpus / task: [Examples — transformers 4.2.0 documentation](https://huggingface.co/transformers/examples.html)
---
**Author:**  [@VP1](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FVP1)%5C
**Post date:** [February 3, 2021, 4:17pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-spanish-bert-model%2F3482%2F5 "2021-02-03T16:17:49Z")
i made it confusing; it is with your own text data;
are you trying to fine-tune for a certain task as @lewtun mentioned and then there are examples in the link he provided;
or are you trying to fine-tune BERT (as language modeling) with domain-specific vocab/text to adjust for a certain domain - for this you can use the first example in his link (language model): [transformers/examples/language-modeling at master · huggingface/transformers · GitHub](https://github.com/huggingface/transformers/tree/master/examples/language-modeling)
---
**Author:**  [@Armando](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FArmando)%5C
**Post date:** [February 3, 2021, 4:49pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-spanish-bert-model%2F3482%2F6 "2021-02-03T16:49:36Z")
Hi @VP1 and @lewtun ,
thank you very much for your kind reply. Yes, as you mention @VP1, I am trying to fine-tune BERT (as language modeling) with domain-specific vocab/text. Thank you very much I will try it.
---
**Author:**  [@VP1](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FVP1)%5C
**Post date:** [February 3, 2021, 5:50pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tunning-spanish-bert-model%2F3482%2F7 "2021-02-03T17:50:06Z")
@Armando, it should be quite easy to fine-tune with the language modeling scripts.
Let me know if it worked for particularly this model:
> **[dccuchile/bert-base-spanish-wwm-cased at main](https://huggingface.co/dccuchile/bert-base-spanish-wwm-cased/tree/main)**
I am not sure about it, I tried different models but not all worked for fine-tuning with domain-specific vocab.