These quantized models have a smaller memory footprint, but acceptable quality.
chicken
Crataco
AI & ML interests
Using my best computers to quantize LLMs for your worst computers
Recent Activity
liked a model 3 days ago
SporkySporkness/gemma-4-26B-A4B-GGUF liked a model over 1 year ago
dphn/Dolphin3.0-Llama3.2-1B liked a model over 1 year ago
dphn/Dolphin3.0-Qwen2.5-1.5BOrganizations
None yet
models 18
Crataco/Nous-Hermes-2-Mistral-7B-DPO-imatrix-GGUF
7B • Updated • 378 • 5
Crataco/phi-2-orange-v2-imatrix-GGUF
3B • Updated • 163 • 1
Crataco/stablelm-2-1_6b-chat-imatrix-GGUF
2B • Updated • 6.27k • 2
Crataco/cream-phi-2-v0.2-imatrix-GGUF
3B • Updated • 50 • 2
Crataco/distilgpt2-82M-GGUF
0.1B • Updated • 201 • 3
Crataco/TinyDolphin-2.8-1.1b-imatrix-GGUF
1B • Updated • 93 • 6
Crataco/TinyDolphin-2.8.2-1.1B-laser-GGUF
1B • Updated • 133
Crataco/Metharme-1.3B-GGML
Text Generation • Updated
Crataco/RWKV-4-PilePlus-Series-GGML
Text Generation • Updated • 3
Crataco/GPT-2-Series-GGML
Text Generation • Updated • 4
datasets 0
None public yet