Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

733

Base only

Active filters: fp4

FreedomAISVR/Qwen3.5-9B-Instruct-MTP-MXFP4-GGUF

Text Generation • 0.5B • Updated May 25 • 206

crushleorey/Qwopus3.6-27B-v2-NVFP4

Image-Text-to-Text • 15B • Updated May 26 • 1.07k • 6

dlsxj101/A.X-3.1-NVFP4

Text Generation • 18B • Updated Jun 7 • 10 • 2

giangndm/qwen3-30b-omni-text-only-nvfp4

Text Generation • 17B • Updated May 29 • 10

lemuralabs/Step-3.7-Flash-MXFP4-mlx

Image-Text-to-Text • 201B • Updated Aug 5 • 76

sakamakismile/LFM2.5-8B-A1B-NVFP4

Text Generation • 5B • Updated May 31 • 4.31k • 8

coolthor/Sulphur-2-distilled-NVFP4

Text-to-Video • Updated Jun 2 • 2.84k • 4

Reza2kn/Cosmos3-Nano-NVFP4-AWQ

Text-to-Image • Updated Jun 2 • 16 • 5

sakamakismile/Huihui-LFM2.5-8B-A1B-abliterated-NVFP4

Text Generation • 5B • Updated Jun 2 • 244 • 4

coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4-W4A4

Image-Text-to-Text • 21B • Updated Jun 2 • 499

hoja-solutions/Llama-3.1-70B-LatamGPT-SFT-1.0-NVFP4

Text Generation • 41B • Updated Jun 2 • 32

TentaFlow/Bielik-1.5B-NVFP4

Text Generation • 0.9B • Updated Jun 2 • 19 • 1

TentaFlow/Bielik-4.5B-v3.0-Instruct-NVFP4

Text Generation • 3B • Updated Jun 2 • 12

TentaFlow/TentaGuard-NVFP4

Text Classification • 0.5B • Updated Jun 2 • 8

aastalll/Qwen3.5-35B-A3B-NVFP4-MTP

Image-Text-to-Text • 21B • Updated Jun 3 • 12

AxionML/Gemma-4-12B-NVFP4

Image-Text-to-Text • 8B • Updated Jun 4 • 2.97k • 8

Reza2kn/gemma-4-26B-A4B-it-assistant-NVFP4

Text Generation • Updated 7 days ago • 264 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-MLXFP4

Image-Text-to-Text • 12B • Updated Jun 21 • 770 • 3

melcheikh/gemma-4-31B-it-qat-NVFP4-Blackwell

Text Generation • 17B • Updated Jun 8 • 522 • 4

melcheikh/gemma-4-31B-it-qat-assistant-NVFP4-Blackwell

Text Generation • 0.4B • Updated Jun 8 • 32 • 4

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4

Text Generation • 8B • Updated Jul 15 • 851 • 1

sakamakismile/LFM2.5-1.2B-JP-202606-NVFP4

Text Generation • 0.8B • Updated Jun 6 • 36 • 1

AEON-7/Gemma-4-12B-it-AEON-Abliterated-K4-NVFP4-FP8

Text Generation • 8B • Updated Jul 15 • 489

RazielXYZ/Nex-N2-Pro-NVFP4

Text Generation • Updated Jun 6 • 35 • 5

JongYeop/Qwen3-30B-A3B-NVFP4-W4A4

Text Generation • 17B • Updated Jun 7 • 39

hackerwasii/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Jun 7 • 8

Reza2kn/rf-detr-segmentation-NVFP4

Image Segmentation • Updated 7 days ago • 16

hungtrieu07/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Jun 9 • 10

RedHatAI/gemma-4-12B-it-NVFP4

Any-to-Any • 13B • Updated Aug 13 • 11.6k • 6

GulfCoastAI/Mistral-Small-4-119B-Heretic-NVFP4

68B • Updated Jun 9 • 176 • 4