Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

30

Base only

Active filters: llamacpp

DavidAU/support

Any-to-Any • Updated about 23 hours ago • 25

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated Jul 27, 2025 • 272

pragmaticcs/MiMo-HERO-Frontier-Agentic-Coder-9B-GGUF

Text Generation • 9B • Updated 4 days ago • 2

rob-x-ai/neural-chat-7b-v3-1-GGUF

7B • Updated Nov 28, 2023 • 79

Druvith/mistralmed-7b-v1.5.gguf

7B • Updated Feb 3, 2024 • 10

rxavier/Taurus-7B-1.0-GGUF

7B • Updated Feb 25, 2024 • 86

BramVanroy/GEITje-7B-ultra-GGUF

7B • Updated Dec 6, 2024 • 1.13k • 10

Vikhrmodels/it-5.3-fp16-32k-GGUF

8B • Updated Jun 13, 2024 • 400 • 2

rubra-ai/Meta-Llama-3-8B-Instruct-GGUF

9B • Updated Jul 4, 2024 • 412 • 4

Vikhrmodels/it-5.4-fp16-orpo-v2-GGUF

8B • Updated Jul 14, 2024 • 516 • 4

Dracones/gemma-2-9b-it-GGUF

Text Generation • 9B • Updated Jul 20, 2024 • 104

Dracones/gemma-2-27b-it-GGUF

Text Generation • 27B • Updated Jul 22, 2024 • 165

Vikhrmodels/Vikhr-Gemma-2B-instruct-GGUF

Text Generation • 3B • Updated Aug 23, 2024 • 4.7k • 20

flowaicom/Flow-Judge-v0.1-GGUF

Text Generation • 4B • Updated Sep 18, 2024 • 439 • 10

Vikhrmodels/Vikhr-Llama-3.2-1B-instruct-GGUF

Text Generation • 1B • Updated Sep 27, 2024 • 2.32k • 17

Vikhrmodels/Vikhr-Qwen-2.5-0.5B-instruct-GGUF

Text Generation • 0.5B • Updated Oct 6, 2024 • 915 • 10

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_GGUF

2B • Updated Feb 3, 2025 • 342 • 10

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-r_GGUF

2B • Updated Feb 11, 2025 • 483 • 4

vicharai/ViCoder-html-32B-preview-GGUF

Text Generation • 33B • Updated Apr 24, 2025 • 187 • 4

Gardeviance/MS-Gardventure-MW-V1-22B-IQ4_NL-GGUF

Text Generation • 22B • Updated Sep 22, 2025 • 31

Dca3271144691983/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

lucky087/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

rowandwhelan/llamacpp-vocab-array-type-mismatch-poc

wazimondo/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

XXXMARK/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

xxrickyxx/AILOFlow

Text Generation • Updated Aug 10 • 2

Arm/deepseek-r1-distill-qwen-1-5b-q4-k-m-llamacpp-vivo-x300

Text Generation • 2B • Updated 23 days ago • 443

Arm/qwen3-5-0-8b-q4-k-m-llamacpp-vivo-x300

Text Generation • 0.8B • Updated 23 days ago • 301

Arm/qwen3-vl-2b-instruct-q4-k-m-ggml-llama-cpp-vivo-x300

Image-Text-to-Text • 2B • Updated 23 days ago • 881

UCB-team/unclickbait-sft-4b-v2-gguf

Text Generation • 4B • Updated Oct 4 • 37