Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

27

Base only

Active filters: sm120

lyf/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • 21B • Updated Jun 13 • 29.9k • 12

sakamakismile/Huihui-gemma-4-26B-A4B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 16B • Updated Jun 12 • 750 • 2

Kevletesteur/chimere-system

Text Generation • Updated Apr 7 • 1

SecondNatureComputing/flash-attn-4-sm120

Updated Apr 26 • 4

0xSero/DeepSeek-V3.2-508B-NVFP4

Text Generation • 2B • Updated May 30 • 14

Chiling0/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • Updated Apr 26 • 139 • 2

vonkaiser/flash-attn-4-sm120

natfii/Qwen3.6-27B-VLM-NVFP4-MTP

Image-Text-to-Text • 17B • Updated Jun 10 • 1.94k • 6

Sggin/sage-attention-2.2-dgx-spark-aarch64-cu13

tjarvis91/qovaryx-50m-scratch-base

Text Generation • Updated Jun 5 • 18

tjarvis91/qovaryx-350m-scratch-base

Text Generation • Updated Jun 5 • 21 • 1

tjarvis91/qovaryx-1b-scratch-base

Text Generation • Updated Jun 5 • 21

tjarvis91/qovaryx-3b-scratch-base

Text Generation • Updated Jun 5 • 5

sakamakismile/Huihui-gemma-4-12B-it-abliterated-NVFP4A16

Image-Text-to-Text • 7B • Updated Jun 7 • 1.56k • 2

sakamakismile/Huihui-gemma-4-31B-it-qat-abliterated-NVFP4

Image-Text-to-Text • 18B • Updated Jun 12 • 356

sakamakismile/Huihui-gemma-4-26B-A4B-it-qat-abliterated-pad768-NVFP4

Image-Text-to-Text • 16B • Updated Jun 12 • 376

sakamakismile/Huihui-gemma-4-31B-it-qat-abliterated-MTP-NVFP4

Image-Text-to-Text • 18B • Updated Jun 12 • 540 • 1

sakamakismile/gemma-4-12B-coder-fable5-composer2.5-MTP-NVFP4

Text Generation • 7B • Updated Jun 16 • 4.01k • 49

sakamakismile/Huihui-Nex-N2-mini-abliterated-MTP-NVFP4

Image-Text-to-Text • 20B • Updated Jun 16 • 121 • 6

sakamakismile/Huihui-Nex-N2-mini-abliterated-text-MTP-NVFP4

Text Generation • 20B • Updated Jun 16 • 17

Kimuraxhalu/gemma-4-12B-coder-fable5-composer2.5-MTP-NVFP4

Text Generation • 7B • Updated Jun 16 • 96 • 3

will1208/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-NVFP4

Image-Text-to-Text • 21B • Updated 23 days ago • 108

aquaman164/GLM-5.2-VQ-1.9bit

Text Generation • 50B • Updated 21 days ago • 427

9prodhi/DeepSeek-V4-Flash-moet2pf

Updated 15 days ago

hermia/glm-5.2-sm120-recipe

Updated 13 days ago

hermia/deepseek-v4-flash-sm120-recipe

Updated 11 days ago

anoane/DeepSeek-V4-Flash-vllm-moet-sm120-cache

Updated 10 days ago • 1