# How to continue training without trainer

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-continue-training-without-trainer%2F14065%3E%5C
**Category:** 🤗Transformers\
**Created:** [January 24, 2022, 6:24pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-continue-training-without-trainer%2F14065 "2022-01-24T18:24:57Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![zheyuye](https://avatars.discourse-cdn.com/v4/letter/z/fbc32d/32.png) [@zheyuye](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fzheyuye)%5C
**Post date:** [January 24, 2022, 6:24pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhow-to-continue-training-without-trainer%2F14065%2F1 "2022-01-24T18:24:57Z")

</div>

I am trying to continue training my model from a checkpoint, without Trainer. The model for continued training seemed incoherent with the previously saved model on both loss and evaluateion results. I am wondering f I didn’t save model correctly and missing Optimizer memory info. Here is the way how i save the model

```auto
accelerator.wait_for_everyone()
            unwrapped_model = accelerator.unwrap_model(model)
            unwrapped_model.save_pretrained(args.output_dir, save_function=accelerator.save)
            if accelerator.is_main_process:
                tokenizer.save_pretrained(args.output_dir)

```