RedHatAI/Sparse-Llama-3.1-8B-evolcodealpaca-2of4 Text Generation • 8B • Updated Nov 21, 2024 • 14 • 1
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 Text Generation • 3B • Updated Oct 23, 2024 • 3.24k • 12
RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic Text Generation • 71B • Updated Oct 19, 2024 • 2.52k • 7
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • 406B • Updated Oct 19, 2024 • 8.4k • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • 58B • Updated Oct 10, 2024 • 110 • 12