Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28

Base only

Active filters: magicquant

magiccodingman/Qwen3.8-27B-MXFP4-MagicQuant-GGUF

Image-Text-to-Text • 27B • Updated 5 days ago • 3.37k • 3

magiccodingman/Qwen3.6-35B-A3B-MagicQuant-GGUF

Text Generation • 35B • Updated May 26 • 602 • 6

lmcoleman/Qwen3.8-27B-MagicQuant-GGUF

Text Generation • 27B • Updated 11 days ago • 923 • 3

magiccodingman/Qwen3.8-27B-MagicQuant-GGUF

Text Generation • 27B • Updated 11 days ago • 5.99k • 12

magiccodingman/Granite-4.0-H-350M-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 0.3B • Updated Apr 25 • 90 • 1

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 317 • 8

magiccodingman/Qwen3-4B-Thinking-2507-Unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 4B • Updated Apr 25 • 239 • 2

magiccodingman/Qwen3-30B-A3B-Thinking-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 208 • 5

magiccodingman/Qwen3-30B-A3B-Instruct-2507-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 31B • Updated Apr 25 • 175 • 4

magiccodingman/Seed-OSS-36B-Instruct-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 36B • Updated Apr 25 • 592 • 10

magiccodingman/Apriel-1.5-15b-Thinker-unsloth-MagicQuant-Hybrid-GGUF

Text Generation • 14B • Updated Apr 25 • 141 • 2

magiccodingman/Qwen3-4B-Instruct-2507-Unsloth-MagicQuant-v2-GGUF

Text Generation • 4B • Updated May 26 • 181 • 1

magiccodingman/Qwen3.6-35B-A3B-Uncensored-MagicQuant-GGUF

Text Generation • 35B • Updated May 26 • 1.23k • 5

magiccodingman/Qwen3.6-27B-MagicQuant-MTP-GGUF

Text Generation • 27B • Updated May 26 • 465 • 4

magiccodingman/Qwen3.6-27B-Uncensored-MagicQuant-MTP-GGUF

Text Generation • 27B • Updated May 26 • 444 • 4

lmcoleman/ThinkingCap-Qwen3.6-27B-MagicQuant-GGUF

Text Generation • 27B • Updated 11 days ago • 4.86k • 6

lmcoleman/ThinkingCap-Qwen3.6-27B-ROCmFPX-GGUF

Text Generation • 27B • Updated 28 days ago • 1.85k • 7

lmcoleman/Qwen3.6-27B-Fable-Fusion-711-MTP-MagicQuant-GGUF

Text Generation • 0.5B • Updated 11 days ago • 2.44k • 1

lmcoleman/Qwen3.6-27B-Fable-Fusion-711-MTP-ROCmFPX-GGUF

Text Generation • 0.5B • Updated 25 days ago • 10.8k • 5

lmcoleman/Qwen3.6-35B-A3B-MagicQuant-GGUF

Text Generation • 36B • Updated 11 days ago • 419

lmcoleman/Qwen3.6-35B-A3B-ROCmFPX-GGUF

Text Generation • 36B • Updated about 1 month ago • 141

lmcoleman/Qwen3.6-35B-A3B-BUDGET-GGUF

Text Generation • 36B • Updated 11 days ago • 903 • 1

spotapovadm/Qwen3.6-35B-A3B-ROCmFPX-GGUF

Text Generation • 36B • Updated 21 days ago • 111 • 1

lmcoleman/Muse-Glimmer-30B-MagicQuant-GGUF

Text Generation • 28B • Updated 11 days ago • 312

lmcoleman/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-MagicQuant-GGUF

33B • Updated 11 days ago • 692

lmcoleman/Qwen3.8-27B-ROCmFPX-GGUF

Text Generation • 27B • Updated 15 days ago • 4.55k • 7

lmcoleman/Ornith-1.5-35B-A3B-MagicQuant-GGUF

Image-Text-to-Text • 36B • Updated 9 days ago • 441

lmcoleman/Ornith-1.5-35B-A3B-ROCmFPX-GGUF

Image-Text-to-Text • 36B • Updated 9 days ago • 228