# How to merge multiple LoRA back to base model?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-merge-multiple-lora-back-to-base-model%2F65741%3E%5C
**Category:** 🤗Transformers\
**Created:** [December 14, 2023, 1:12am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-merge-multiple-lora-back-to-base-model%2F65741 "2023-12-14T01:12:21Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![leonsun](https://avatars.discourse-cdn.com/v4/letter/l/71e660/32.png) [@leonsun](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fleonsun)%5C
**Post date:** [December 14, 2023, 1:12am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-merge-multiple-lora-back-to-base-model%2F65741%2F1 "2023-12-14T01:12:21Z")

</div>

I had finetuned two LoRA. The first one was tuned with raw text to let model know the knowledge and the second one was tuned with many Querstion/Answer pairs. Both have somewhat better result than base model after they are merged backed to base model. But if i merged them together back to base model, it doesn’t get better result. What should i do for it? What’s the best practice to merge multiple lora?