Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,220

Base only

Active filters: fp8

RedHatAI/Apertus-70B-Instruct-2509-quantized.w4a16

Text Generation • 11B • Updated Sep 23, 2025 • 240k • 2

deepseek-ai/DeepSeek-V3.2-Exp

Text Generation • 685B • Updated Nov 18, 2025 • 130k • • 996

Qwen/Qwen3-VL-4B-Instruct-FP8

Image-Text-to-Text • 5B • Updated Oct 15, 2025 • 300k • 66

Qwen/Qwen3-VL-32B-Instruct-FP8

Image-Text-to-Text • 33B • Updated Oct 22, 2025 • 310k • 48

mistralai/Ministral-3-14B-Instruct-2512

14B • Updated Jul 15 • 216k • 314

mistralai/Ministral-3-8B-Instruct-2512

9B • Updated Jul 15 • 133k • 195

mistralai/Ministral-3-3B-Instruct-2512

4B • Updated Jul 15 • 401k • 275

jane-street/dormant-model-1

671B • Updated Nov 15, 2025 • 24 • 18

ai-sage/GigaChat3-702B-A36B-preview

Text Generation • 715B • Updated Nov 24, 2025 • 182 • 90

unsloth/Qwen3-4B-Thinking-2507-FP8

Text Generation • 4B • Updated Nov 20, 2025 • 99 • 3

unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF

24B • Updated Dec 15, 2025 • 37.3k • 166

RedHatAI/Qwen3-VL-32B-Instruct-NVFP4

Text Generation • 20B • Updated Dec 10, 2025 • 6.81k • 7

MiniMaxAI/MiniMax-M2.1

Text Generation • 229B • Updated Feb 13 • 24.2k • • 1.36k

Hellohal2064/vllm-dgx-spark-gb10

Text Generation • Updated Jan 6 • 9

Photoroom/FLUX.2-klein-4b-fp8-diffusers

Image-to-Image • Updated Feb 18 • 14

Qwen/Qwen3.5-122B-A10B-FP8

Image-Text-to-Text • 125B • Updated Apr 24 • 1.79M • 113

lovedheart/Qwen3.5-9B-FP8

Image-Text-to-Text • 10B • Updated Mar 2 • 26k • 15

AEmotionStudio/SeedVR2-models

3B • Updated Jun 24 • 1.54k • 3

prithivMLmods/gemma-4-31B-it-FP8

Image-Text-to-Text • 33B • Updated Apr 3 • 8.13k • 4

RedHatAI/gemma-4-26B-A4B-it-FP8-dynamic

Image-Text-to-Text • 27B • Updated 6 days ago • 557k • 39

ghecko78/Voxtral-Mini-4B-Realtime-2602-FP8-Dynamic

Automatic Speech Recognition • 4B • Updated May 22 • 622 • 3

binedge/dots.mocr-FP8

Image-Text-to-Text • 3B • Updated Apr 16 • 1.19k • 1

kakrotto/gemma-4-31B-it-uncensored-heretic-FP8

31B • Updated Apr 18 • 1.06k • 4

SeeSee21/Z-Anime

Text-to-Image • 6B • Updated Apr 27 • 1.27k • 478

coolthor/Huihui-Qwen3.6-35B-A3B-abliterated-FP8-DYNAMIC

Image-Text-to-Text • 36B • Updated 20 days ago • 269k • 5

bb1975/MiMo-V2.5-Pro

Text Generation • 1T • Updated May 2 • 11 • 1

drbaph/HiDream-O1-Image-FP8

Image-Text-to-Image • 9B • Updated May 10 • 2.23k • 9

RedHatAI/Qwen3.5-4B-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 11 • 93.2k • 5

RedHatAI/Qwen3.5-9B-FP8-dynamic

Image-Text-to-Text • 9B • Updated May 11 • 242k • 7

nvidia/DeepSeek-V4-Pro-NVFP4

Text Generation • 910B • Updated Jun 14 • 136k • 76