Inference Providers
Active filters: 8bit
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 247
• 3
legraphista/RoGemma-7b-Instruct-IMat-GGUF
Text Generation
• 9B • Updated • 209
legraphista/Llama-3-Instruct-8B-SPPO-Iter3-IMat-GGUF
Text Generation
• 8B • Updated • 657
legraphista/Yi-9B-Coder-IMat-GGUF
Text Generation
• 9B • Updated • 134
legraphista/gemma-2-9b-it-IMat-GGUF
Text Generation
• 9B • Updated • 539
• 2
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
• 27B • Updated • 585
• 20
legraphista/llm-compiler-7b-IMat-GGUF
Text Generation
• 7B • Updated • 1.93k
legraphista/llm-compiler-7b-ftd-IMat-GGUF
Text Generation
• 7B • Updated • 458
• 2
legraphista/llm-compiler-13b-IMat-GGUF
Text Generation
• 13B • Updated • 300
• 3
legraphista/llm-compiler-13b-ftd-IMat-GGUF
Text Generation
• 13B • Updated • 279
legraphista/Gemma-2-9B-It-SPPO-Iter3-IMat-GGUF
Text Generation
• 9B • Updated • 1.31k
• 4
legraphista/Phi-3-mini-4k-instruct-update2024_07_03-IMat-GGUF
Text Generation
• 4B • Updated • 276
legraphista/internlm2_5-7b-chat-IMat-GGUF
Text Generation
• 8B • Updated • 2.99k
legraphista/internlm2_5-7b-chat-1m-IMat-GGUF
Text Generation
• 8B • Updated • 170
• 1
legraphista/codegeex4-all-9b-IMat-GGUF
Text Generation
• 9B • Updated • 4.97k
• 8
legraphista/NuminaMath-7B-TIR-IMat-GGUF
Text Generation
• 7B • Updated • 193
• 1
legraphista/mathstral-7B-v0.1-IMat-GGUF
Text Generation
• 7B • Updated • 163
legraphista/Athene-70B-IMat-GGUF
Text Generation
• 71B • Updated • 413
• 3
legraphista/Mistral-Nemo-Instruct-2407-IMat-GGUF
Text Generation
• 12B • Updated • 212
• 2
legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 340
• 6
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF
Text Generation
• 71B • Updated • 399
• 11
legraphista/Llama-Guard-3-8B-IMat-GGUF
Text Generation
• 8B • Updated • 414
• 5
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
• 123B • Updated • 215
• 29
legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUF
Text Generation
• 8B • Updated • 312
• 1
legraphista/gemma-2-2b-it-IMat-GGUF
Text Generation
• 3B • Updated • 3.01k
• 2
legraphista/gemma-2-2b-IMat-GGUF
Text Generation
• 3B • Updated • 355
• 1
legraphista/Palmyra-Fin-70B-32K-IMat-GGUF
Text Generation
• 71B • Updated • 362
• 10
legraphista/internlm2_5-1_8b-chat-IMat-GGUF
Text Generation
• 2B • Updated • 184
legraphista/internlm2_5-20b-chat-IMat-GGUF
Text Generation
• 20B • Updated • 419
legraphista/shieldgemma-2b-IMat-GGUF
Text Generation
• 3B • Updated • 293