GPTQ available
#7
by
MaziyarPanahi - opened
Hi,
Thanks for sharing your amazing model with the community. Specially in such small size!
I have quantized it to GPTQ format in case anyone has low GPU resources.
https://huggingface.co/MaziyarPanahi/Starling-LM-7B-beta-GPTQ