Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,502

Base only

Active filters: auto-round

albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE

Text Generation • 73B • Updated 9 days ago • 719 • 22

Intel/Qwen3.8-Flash-Next-W4A16-AutoRound

Image-Text-to-Text • 75B • Updated 14 days ago • 36k • 21

JC1DA/Qwen3.8-27B-DavidAU-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-INT4-W4A16

Image-Text-to-Text • 6B • Updated 10 days ago • 2.24k • 9

dbirks/Qwen3.8-27B-W4A16-AutoRound

Image-Text-to-Text • 6B • Updated 30 days ago • 104k • 30

biMEMO/Ornith-1.5-35B-A3B-int4-AutoRound-MTP

6B • Updated 20 days ago • 8.74k • 5

ranxianglei/Qwen3.8-Flash-Next-W4A16-Modular

66B • Updated 10 days ago • 158 • 5

HaberstrohSystems/Qwen3.8-Flash-Next-int2-mixed-AutoRound-24GB-SGLang

Text Generation • 11B • Updated 11 days ago • 386 • 5

Vishva007/Qwen3.8-27B-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 3B • Updated 4 days ago • 34.2k • 10

Intel/GLM-5.3-Flash-W4A16-AutoRound

Text Generation • 50B • Updated 13 days ago • 2.18k • 13

Intel/Qwen3.5-122B-A10B-int4-AutoRound

20B • Updated Apr 16 • 239k • 49

Intel/gemma-4-31B-it-int4-AutoRound

6B • Updated May 1 • 32.7k • 53

INCModel2/GLM-5.2-MXFP4-CT-AutoRound

Text Generation • 753B • Updated 5 days ago • 198 • 1

devan-carlin/Qwen3.8-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated 15 days ago • 14.9k • 5

biMEMO/Qwen3.8-27B-int4-AutoRound

6B • Updated 27 days ago • 9.03k • 5

Frozenlock/Qwen3.8-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated 29 days ago • 38.7k • 19

ababaka/Huihui-Qwen3.8-27B-Abliterated-W4A16-AutoRound

6B • Updated 20 days ago • 2.06k • 3

CySpiegel/Qwen3.8-27B-Int4-AutoRound

6B • Updated 18 days ago • 244 • 2

INCModel3/GLM-5.3-Flash-W4A16-RTN-AutoRound

Text Generation • 50B • Updated 13 days ago • 244 • 1

issaxde/Qwen2.5-Coder-7B-AutoRound-W4A16

Text Generation • 2B • Updated 13 days ago • 90 • 1

hampsonw/Qwen3.8-Flash-Next-W4A16-AutoRound-MTP-INT4-Experts

Image-Text-to-Text • Updated 12 days ago • 95 • 2

todiadiyatmo/Qwen3.8-Flash-Next-W4A16-Attn8-FP8PLE

Text Generation • 71B • Updated about 17 hours ago • 114 • 1

weddle/Qwen3.8-27B-AutoRound-W4A16-G128

Image-Text-to-Text • 6B • Updated 4 days ago • 29 • 1

quant-mind/Nex-N2.5-mini-W4A16-AutoRound

Text Generation • 6B • Updated 1 day ago • 175 • 1

Jon-Nielsen/Qwen3.8-Flash-Next-Merlin-3090-Serving-Kit

Text Generation • Updated 1 day ago • 1

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-sym

Text Generation • 0.3B • Updated Jan 4, 2025 • 14

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_round-int4-gs128-asym

Text Generation • 0.3B • Updated Jan 4, 2025 • 9

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • 2B • Updated Jan 4, 2025 • 10

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 2B • Updated Jan 4, 2025 • 10

OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc

11B • Updated Apr 30, 2025 • 6 • 1

OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc

6B • Updated Apr 30, 2025 • 472 • 1