# Input for multilingual EncoderDecoderModel

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Finput-for-multilingual-encoderdecodermodel%2F22824%3E%5C
**Category:** Beginners\
**Created:** [September 9, 2022, 7:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Finput-for-multilingual-encoderdecodermodel%2F22824 "2022-09-09T07:23:47Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![PandaKata](https://avatars.discourse-cdn.com/v4/letter/p/eb8c5e/32.png) [@PandaKata](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FPandaKata)%5C
**Post date:** [September 9, 2022, 7:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Finput-for-multilingual-encoderdecodermodel%2F22824%2F1 "2022-09-09T07:23:47Z")

</div>

Hello guys,

I want to train a multilingual EncoderDecoderModel for translation.

```auto
model = EncoderDecoderModel.from_encoder_decoder_pretrained('xlm-roberta-base', 'EleutherAI/gpt-j-6B')

```

Now I’m having a hard time figuring out what input is needed. I have several parallel corpora in different languages - do I need to combine them all into one corpus?

Thank you!