Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,024

Base only

Active filters: quantization

neopolita/Qwen3.6-23B-A3B-Niwaki-v2.1-2bit-gguf

Text Generation • 23B • Updated 8 days ago • 127

UraionLabs/MiniCPM5-2B-oQ8e

Text Generation • 3B • Updated 8 days ago • 200

UraionLabs/MiniCPM5-2B-oQ6e

Text Generation • 3B • Updated 8 days ago • 147

UraionLabs/MiniCPM5-2B-oQ5e

Text Generation • 3B • Updated 8 days ago • 147

UraionLabs/MiniCPM5-2B-oQ3e

Text Generation • 3B • Updated 8 days ago • 159

UraionLabs/MiniCPM5-2B-oQ3.5e

Text Generation • 3B • Updated 8 days ago • 153

UraionLabs/MiniCPM5-2B-oQ2e

Text Generation • 3B • Updated 8 days ago • 169

UraionLabs/MiniCPM5-2B-oQ2.7e

Text Generation • 3B • Updated 8 days ago • 162

UraionLabs/MiniCPM5-2B-oQ2.5e

Text Generation • 3B • Updated 8 days ago • 206

timtimtimtimtim/Qwen3.8-27B-MXFP4-GGUF

27B • Updated 8 days ago • 318

timtimtimtimtim/Qwen3.5-4B-MXFP4-GGUF

4B • Updated 8 days ago • 288

timtimtimtimtim/Qwen3.6-35B-A3B-MXFP4-GGUF

35B • Updated 8 days ago • 320

KissTheHabit/yolov8n-table-yolo

Object Detection • Updated 5 days ago

Soulfate24/PaddleOCR-VL-1.6-ASHQ1-Remix-GGUF

Image-Text-to-Text • 0.5B • Updated 8 days ago • 994

gratex/Ornith-1.5-397B-W4A16-g32-sym

Text Generation • 71B • Updated 8 days ago • 118

hoatac/gemma-4-E4B-it-AWQ

Text Generation • 8B • Updated 8 days ago • 731

hoatac/gemma-4-E4B-it-AWQ-mm

Image-Text-to-Text • 8B • Updated 8 days ago • 36

vcruz305/DSV4.1-Flash-EXL3-4.75bpw

Text Generation • 325B • Updated 8 days ago • 108 • 1

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-NVFP4-W4A4

Image-Text-to-Text • 30B • Updated 3 days ago • 98 • 2

Shinrali/Qwen3.8-Flash-Next-NVIDIA-Hybrid-Single-Spark

Image-Text-to-Text • 118B • Updated 6 days ago • 495

Shinrali/Qwen3.8-Flash-Next-NVIDIA-Hybrid-FP8-LMHead-Single-Spark

Image-Text-to-Text • 118B • Updated 43 minutes ago • 71

Gugu8/Tern-1.5

Text Generation • Updated 6 days ago • 658

vcruz305/DSV4.1-Flash-SAGE-EXL3-3.30bpw

Text Generation • 325B • Updated 7 days ago • 613 • 1

experimentalmachines/QwenGrad-Qwen3.5-2B-M1-DPO-v2-ExecuTorch-CPU

Updated 7 days ago • 9

wepiqx/NeoHorse-1-9B-MERNIK-GGUF

Text Generation • 9B • Updated 5 days ago • 3.16k • 2

InfiniCloud/Qwen3.5-9B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated 7 days ago • 24

InfiniCloud/Qwen3.5-9B-GPTQ-INT4-G128

Image-Text-to-Text • 9B • Updated 7 days ago • 28

wcamon/Agents-A1-4B-Wringer-Q2.6

Updated 7 days ago

whcl412/LycheeAI-coder-2b-II-pro

Text Generation • 3B • Updated 6 days ago • 552

InfiniCloud/gemma-4-26B-A4B-it-GPTQ-INT4-G64

Image-Text-to-Text • 26B • Updated 7 days ago • 95