RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16 Text Generation • 0.6B • Updated Feb 27, 2025 • 13 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8 Text Generation • 2B • Updated Feb 27, 2025 • 8.04k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16 Text Generation • 2B • Updated Feb 27, 2025 • 192 • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 6.36k • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic Text Generation • 8B • Updated Feb 27, 2025 • 502 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16 Text Generation • 3B • Updated Feb 27, 2025 • 374 • 1
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8 Text Generation • 15B • Updated Feb 27, 2025 • 4.54k • 2
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16 Text Generation • 6B • Updated Feb 27, 2025 • 715 • 5
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8 Text Generation • Updated Feb 27, 2025 • 277 • 13
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic Text Generation • 33B • Updated Feb 27, 2025 • 1.82k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 Text Generation • 11B • Updated Feb 27, 2025 • 1.22k • 6
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8 Text Generation • 71B • Updated Feb 27, 2025 • 145 • 2
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic Text Generation • 71B • Updated Feb 27, 2025 • 16k • 10
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16 Text Generation • 2B • Updated Feb 27, 2025 • 1.83k
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8 Text Generation • 8B • Updated Feb 27, 2025 • 5.77k • 2
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • 71B • Updated Feb 12, 2025 • 114k • 32
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Feb 11, 2025 • 2.79k • 21