Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,037

Base only

Active filters: quantization

TelperionAI/Qwen3.8-27B-EXL3-5.5bpw-v2

11B • Updated 16 days ago • 44 • 1

neopolita/Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit-mlx

Text Generation • 87B • Updated 14 days ago • 913 • 1

neopolita/Qwen3.8-Flash-Next-113B-A5B-Niwaki-3bit-gguf

Text Generation • 121B • Updated 14 days ago • 1.23k • 2

aufjsufjaujda3/vdn-minimax-h3-int8-convrot-comfyui

Updated 15 days ago • 99

agentlans/Apertus-v1.1-4B-Instruct-GGUF

4B • Updated 15 days ago • 551

LookUpMark/Ornith-1.5-35B-A3B-oQ4e-mtp

Text Generation • 36B • Updated 14 days ago • 472

LookUpMark/Ornith-1.5-35B-A3B-oQ6e-mtp

Text Generation • 36B • Updated 14 days ago • 469

LookUpMark/Ornith-1.5-35B-A3B-oQ8e-mtp

Text Generation • 36B • Updated 14 days ago • 510

HBB-Community/wit-GGUF

Text Generation • 0.1B • Updated 14 days ago • 371

SofiTesfay2010/Agents-A1-Flash

Text Generation • 8B • Updated 14 days ago • 324

chenjiaj109550158/AbsorbQuant-NVFP4

Text-to-Image • Updated 9 days ago

pixelwandere34/Qwen3.8-27B-QUASAR-NVFP4

Image-Text-to-Text • 28B • Updated 14 days ago • 143

Rotem12/kokoro-thai-q8-onnx

Text-to-Speech • Updated 13 days ago • 60

wepiqx/Ling-3.0-tiny-ASHQ1-GGUF

Text Generation • 8B • Updated 13 days ago • 807 • 1

wepiqx/Ornith-1.5-9B-MTP-ASHQ1-GGUF

Text Generation • 9B • Updated 7 days ago • 2.28k • 1

wepiqx/Spark-X2.5-4B-ASHQ1-GGUF

Text Generation • 4B • Updated 9 days ago • 1.02k • 1

JBruceAI/VoronoiReasoner-41M-IT-GGUF

Text Generation • 41.9M • Updated 13 days ago • 646 • 1

sayedM/cohere-transcribe-arabic-cpu-friendly

Automatic Speech Recognition • 2B • Updated 13 days ago • 40 • 3

TitanMamo10/qwen25-qat-q3-poc

0.5B • Updated 13 days ago • 122

Duke-CEI-SVD/traj-mc

Updated 13 days ago

elichen-skymizer/GAP-models

31B • Updated 8 days ago • 42.8k

MingZwhy/qwen3-8b-hif4-l16-17-18

8B • Updated 13 days ago • 16

collectiveai/canary-1b-v2-onnx-split-int8

Automatic Speech Recognition • Updated 12 days ago • 30

joeblowma/Qwopus3.5-9B-Coder-MTP-GGUF

Image-Text-to-Text • 9B • Updated 12 days ago • 1.33k

benjzzz/DeepSeek-V4-Flash-GALE-1bit

Updated 11 days ago • 1

lackonendes/PAW-27B-X3-GGUF

5B • Updated 8 days ago • 3.07k

nicechester/finbert-sentiment-onnx-quantized

Text Classification • Updated 11 days ago • 73

petergilani/Qwen3.8-Flash-Next-MLX-6bit

Updated 12 days ago • 301

MESHIVEAI/Nemotron-3.5-Lightning-30B-Q4_K_M-Imatrix

Text Generation • 33B • Updated 9 days ago • 56

nassimjp/MiniCPM5-2B-SFT-Pashto-Instruct-GGUF

Text Generation • 3B • Updated 11 days ago • 193