# Decoder only fine-tuning enough for UMT5

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdecoder-only-fine-tuning-enough-for-umt5%2F64022%3E%5C
**Category:** Models\
**Created:** [November 29, 2023, 5:03pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdecoder-only-fine-tuning-enough-for-umt5%2F64022 "2023-11-29T17:03:12Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![nitinsurya](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/nitinsurya/32/21687_2.png) [@nitinsurya](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fnitinsurya)%5C
**Post date:** [November 29, 2023, 5:03pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fdecoder-only-fine-tuning-enough-for-umt5%2F64022%2F1 "2023-11-29T17:03:12Z")

</div>

Looking into fine-tuning UMT5 (encoder-decoder) model for a translation task.

Has anyone explored end task’s performance difference when finetuning such (unsupervised trained encoder-decoder) model in

- whole model finetuning setting
- decoder only finetuning