# Unable to prepare model for kbit training

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-prepare-model-for-kbit-training%2F55320%3E%5C
**Category:** 🤗Transformers\
**Created:** [September 17, 2023, 9:33am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-prepare-model-for-kbit-training%2F55320 "2023-09-17T09:33:07Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Gustar8](https://avatars.discourse-cdn.com/v4/letter/g/e47774/32.png) [@Gustar8](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FGustar8)%5C
**Post date:** [September 17, 2023, 9:33am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-prepare-model-for-kbit-training%2F55320%2F1 "2023-09-17T09:33:08Z")

</div>

Hi, i am trying to finetune [phi 1.5](https://huggingface.co/microsoft/phi-1_5) on a custom dataset using QLora. When i run:  
model = prepare\_model\_for\_kbit\_training(model)  
I receive the following error  
AttributeError: ‘MixFormerSequentialForCausalLM’ object has no attribute ‘\_set\_gradient\_checkpointing’  
peft version : 0.5.0  
transformer: 4.33.2

---

<div class="post-metadata">

**Author:** ![GowthamYarlagadda](https://avatars.discourse-cdn.com/v4/letter/g/b19c9b/32.png) [@GowthamYarlagadda](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FGowthamYarlagadda)%5C
**Post date:** [September 20, 2023, 8:34pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-prepare-model-for-kbit-training%2F55320%2F2 "2023-09-20T20:34:07Z")

</div>

Same problem here, Because of that the GPU is filling up like crazy. If you got it solved by now, Could you share here?

---

<div class="post-metadata">

**Author:** ![MGDragon](https://avatars.discourse-cdn.com/v4/letter/m/65b543/32.png) [@MGDragon](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FMGDragon)%5C
**Post date:** [November 14, 2023, 4:41pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Funable-to-prepare-model-for-kbit-training%2F55320%2F3 "2023-11-14T16:41:12Z")

</div>

Excuse me, did you solve this ?