AngelSlim/DeepSeek-R1-0528_w4a8_fp8
363B • Updated • 15 • 3
Deepseek-quant
The collection of quantization models of DeepSeek and Deepseek_r1_distill
-
-
AngelSlim/Deepseek_r1_distill_qwen-1_5b_fp8_static
Updated • 5 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_awq
2B • Updated • 16 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-1_5b_int4_gptq
2B • Updated • 6 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_awq
15B • Updated • 39 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-14b_fp8_static
15B • Updated • 12 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-14b_int4_gptq
15B • Updated • 85 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_gptq
33B • Updated • 9 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_gptq
8B • Updated • 110 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-7b_int4_awq
8B • Updated • 116 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-32b_int4_awq
33B • Updated • 420 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-7b_fp8_static
8B • Updated • 7 • 1 -
AngelSlim/Deepseek_r1_distill_qwen-32b_fp8_static
33B • Updated • 4 • 1