RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8
Text Generation • 71B • Updated • 15.8k • 14
AI & ML interests
OpenSource and AI
Recent Activity
View all activity
Papers
SNLP: Layer-Parallel Inference via Structured Newton Corrections
S2D2: Fast Decoding for Diffusion LLMs via Training-Free Self-Speculation
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF
Text Generation • 71B • Updated • 44 • 2
RedHatAI/Mixtral-8x7B-Instruct-v0.1
Text Generation • 47B • Updated • 13k • 1
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-FP8-dynamic
Text Generation • 71B • Updated • 920 • 15
RedHatAI/Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 1.89k • • 5
RedHatAI/Qwen2.5-7B-Instruct
Text Generation • 8B • Updated • 99 •
RedHatAI/Qwen2.5-7B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 27.4k • 1
RedHatAI/granite-3.1-8b-instruct
Text Generation • 8B • Updated • 139 • 1
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation • 8B • Updated • 457 • 1
RedHatAI/Llama-3.3-70B-Instruct
Text Generation • 71B • Updated • 74 •
RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic
Text Generation • 71B • Updated • 39.2k • 16
RedHatAI/phi-4-FP8-dynamic
Text Generation • 15B • Updated • 5.41k • 2
RedHatAI/phi-4-quantized.w8a8
Text Generation • 15B • Updated • 11.2k • 3
RedHatAI/phi-4-quantized.w4a16
Text Generation • 15B • Updated • 34.8k • 5
RedHatAI/phi-4
Text Generation • 15B • Updated • 213 • 1
RedHatAI/Mistral-Small-24B-Instruct-2501
Text Generation • 24B • Updated • 84
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8
Text Generation • 24B • Updated • 13.6k • 2
RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic
Text Generation • 24B • Updated • 3.91k • 13
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503
Image-Text-to-Text • 24B • Updated • 159 • • 1
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text • 24B • Updated • 2.21k • 10
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8
Image-Text-to-Text • 24B • Updated • 835 • 5
RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic
Image-Text-to-Text • 24B • Updated • 33.9k • 9
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8
Image-Text-to-Text • 402B • Updated • 13.2k • 2
RedHatAI/Llama-4-Maverick-17B-128E-Instruct
Image-Text-to-Text • 402B • Updated • 107 • 3
RedHatAI/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text • 109B • Updated • 6.89k
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text • 109B • Updated • 5.57k • 13
RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic
Image-Text-to-Text • 109B • Updated • 7.96k • 29
RedHatAI/Qwen3-8B-speculator.peagle
2B • Updated • 11
RedHatAI/gemma-4-12B-it-NVFP4
8B • Updated • 6.88k
RedHatAI/gemma-4-12B-it-FP8-Dynamic
13B • Updated • 2.85k