# ViT Model increasing CPU RAM when moving to GPU

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fvit-model-increasing-cpu-ram-when-moving-to-gpu%2F21579%3E%5C
**Category:** 🤗Transformers\
**Created:** [August 12, 2022, 8:01pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fvit-model-increasing-cpu-ram-when-moving-to-gpu%2F21579 "2022-08-12T20:01:00Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![benalex](https://avatars.discourse-cdn.com/v4/letter/b/e47774/32.png) [@benalex](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fbenalex)%5C
**Post date:** [August 12, 2022, 8:01pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fvit-model-increasing-cpu-ram-when-moving-to-gpu%2F21579%2F1 "2022-08-12T20:01:00Z")

</div>

Hi,

Unlike with a classical torch.nn.Module, moving a freshly initialized ViTModel to GPU increases CPU RAM by the same amount.  
Anyone know a fix?