Error FineTune with GPU 40GB !!!!!!!!!
#34
by developeranalyser - opened
i have 40GB gpu vram and id get error CUDA out of memory.
with A100 gpu
for fine tune how much gpu vram needed ?
id use colab pro its possible ?
Isn't it ridiculous?
TnkU
how can reduce qpu usage ?