RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w4a16
Text Generation
• 3B • Updated • 503
• 4
RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a16
Text Generation
• 0.6B • Updated • 6
RedHatAI/gemma-2-2b-it-quantized.w4a16
Text Generation
• 1B • Updated • 31
• 1
RedHatAI/gemma-2-9b-it-quantized.w4a16
Text Generation
• 3B • Updated • 17
• 2
RedHatAI/Phi-3-small-128k-instruct-quantized.w8a16
Text Generation
• 3B • Updated • 15
RedHatAI/gemma-2-2b-quantized.w8a16
Text Generation
• 2B • Updated RedHatAI/gemma-2-2b-it-quantized.w8a16
Text Generation
• 2B • Updated • 4
• 1
RedHatAI/gemma-2-9b-it-quantized.w8a16
Text Generation
• 4B • Updated • 36
• 1
RedHatAI/gemma-2-2b-it-FP8
3B • Updated • 75
• 1
RedHatAI/starcoder2-15b-quantized.w8a8
Text Generation
• 16B • Updated • 7
RedHatAI/starcoder2-7b-quantized.w8a8
Text Generation
• 7B • Updated • 12
RedHatAI/starcoder2-3b-quantized.w8a8
Text Generation
• 3B • Updated • 13
RedHatAI/starcoder2-7b-quantized.w8a16
Text Generation
• 2B • Updated • 8
RedHatAI/starcoder2-3b-quantized.w8a16
Text Generation
• 1B • Updated • 12
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a8
Text Generation
• 71B • Updated • 3
RedHatAI/Meta-Llama-3.1-405B-FP8
Text Generation
• 410B • Updated • 16
RedHatAI/Meta-Llama-3.1-70B-quantized.w8a16
Text Generation
• 19B • Updated RedHatAI/starcoder2-3b-FP8
Text Generation
• 3B • Updated • 4
RedHatAI/starcoder2-7b-FP8
Text Generation
• 7B • Updated • 1
RedHatAI/starcoder2-15b-FP8
Text Generation
• 16B • Updated • 117
RedHatAI/Mistral-Nemo-Instruct-2407-quantized.w8a16
Text Generation
• 4B • Updated • 4
RedHatAI/Meta-Llama-3.1-8B-quantized.w8a16
Text Generation
• 3B • Updated • 7
• 1
RedHatAI/Meta-Llama-3.1-70B-FP8
Text Generation
• 71B • Updated • 85
• 2
RedHatAI/Mistral-Large-Instruct-2407-FP8
Text Generation
• 123B • Updated • 92
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16
Text Generation
• 19B • Updated • 207
• 5
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
• 8B • Updated • 460k
• 44
RedHatAI/Mistral-7B-Instruct-v0.3-quantized.w8a8
Text Generation
• 7B • Updated • 17
• 2
RedHatAI/Qwen2-72B-Instruct-quantized.w8a8
Text Generation
• 73B • Updated • 5
• 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation
• 71B • Updated • 42
RedHatAI/Qwen2-7B-Instruct-quantized.w8a8
Text Generation
• 8B • Updated • 171