Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27,160

Full-text search

Active filters: 8-bit

nightmedia/Qwen3.5-122B-A10B-Text-qx85-mlx

Text Generation • 122B • Updated about 7 hours ago • 108 • 2

mlx-community/Qwen3.5-27B-heretic-8bit

Image-Text-to-Text • 8B • Updated about 3 hours ago • 2

MaziyarPanahi/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • 1B • Updated Feb 4, 2024 • 341 • 2

LoneStriker/Meta-Llama-3-8B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Apr 23, 2024 • 5 • 15

MaziyarPanahi/Hermes-2-Pro-Llama-3-13B-GGUF

Text Generation • 12B • Updated Jun 15, 2024 • 100 • 1

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Sep 22, 2025 • 17.9k • 20

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • 22B • Updated Sep 13, 2024 • 107k • 28

Qwen/Qwen2.5-Coder-14B-Instruct-GPTQ-Int8

Text Generation • 15B • Updated Jan 12, 2025 • 8.28k • 6

tiiuae/Falcon3-10B-Instruct-1.58bit

Text Generation • 3B • Updated Jan 13, 2025 • 848 • 22

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 108k • 6

roleplaiapp/oh-dcft-v3.1-claude-3-5-haiku-20241022-Q8_0-GGUF

Text Generation • 8B • Updated Jan 29, 2025 • 33 • 1

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • 24B • Updated Jun 23, 2025 • 109k • 9

meituan/DeepSeek-R1-Channel-INT8

Text Generation • 685B • Updated Feb 27, 2025 • 614 • 32

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • 12B • Updated Mar 12, 2025 • 111k • 16

MaziyarPanahi/Qwen3-0.6B-GGUF

Text Generation • 0.8B • Updated Apr 28, 2025 • 180k • 10

JunHowie/Qwen3-32B-GPTQ-Int8

Text Generation • 33B • Updated Sep 5, 2025 • 1.31k • 4

nvidia/DeepSeek-R1-0528-NVFP4

Text Generation • 397B • Updated Aug 22, 2025 • 16.2k • 42

darkshapes/comma-v0.1-2t-MLX-Q8

Text Generation • 7B • Updated Jul 31, 2025 • 7 • 1

NVFP4/Polaris-4B-Preview-FP4

2B • Updated Jul 23, 2025 • 13 • 1

zankich/Qwen3-32B-INT8

Text Generation • 33B • Updated Jun 30, 2025 • 335 • 2

nvidia/Qwen3-30B-A3B-NVFP4

Text Generation • 16B • Updated Sep 10, 2025 • 57.9k • 24

nvidia/DeepSeek-R1-0528-NVFP4-v2

Text Generation • 394B • Updated Sep 2, 2025 • 122k • 15

NVFP4/Qwen3-30B-A3B-Instruct-2507-FP4

Text Generation • 16B • Updated Aug 1, 2025 • 1.31k • 12

QuantTrio/Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8

Text Generation • 31B • Updated Sep 5, 2025 • 4.24k • 8

yasserrmd/gpt-oss-coder-20b

Text Generation • 12B • Updated Aug 9, 2025 • 194 • 12

Bellesteck/Qwen3-30B-A3B-NVFP4-vLLM

17B • Updated Oct 13, 2025 • 5 • 2

nightmedia/LIMI-Air-qx86-hi-mlx

Text Generation • 107B • Updated Nov 6, 2025 • 18 • 3

AngelSlim/Qwen3-32B_nvfp4

19B • Updated Sep 25, 2025 • 3 • 2

RESMP-DEV/GLM-4.6-NVFP4

Text Generation • 199B • Updated Oct 9, 2025 • 364 • 5

nightmedia/UIGEN-FX-Agentic-32B-qx86-hi-mlx

Text Generation • 33B • Updated Oct 12, 2025 • 15 • 1