# Best practice for finetune LLM

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbest-practice-for-finetune-llm%2F44060%3E%5C
**Category:** Intermediate\
**Created:** [June 21, 2023, 2:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbest-practice-for-finetune-llm%2F44060 "2023-06-21T14:44:33Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mustafa21](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mustafa21/32/36429_2.png) [@Mustafa21](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FMustafa21)%5C
**Post date:** [June 21, 2023, 2:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbest-practice-for-finetune-llm%2F44060%2F1 "2023-06-21T14:44:33Z")

</div>

I have collected a good amount of text dataset and i’m planing to fine-tune a LLM on specific topic

First format is just text (similar to Shakespeare dataset i guess)  
Second format is instructs (similar to alpaca dataset) where there is question and answer

so for the best practice to finet-une a LLM model is to use the first format and then the seond one ?

or its just the second one because its extracted from the first one and cover a big part of it ?

thanks in advance