Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

speculative-decoding

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,305

Base only

Active filters: speculative-decoding

Huang2020/Qwen3-4B-Domino-b16

Text Generation • 0.6B • Updated 13 days ago • 906 • 6

PiehSoft/Qwen3.6-40B-Deckard-MTP

Text Generation • 39B • Updated Jun 18 • 1.77k • 19

mlx-community/Qwen3.6-27B-MTP-bf16

Text Generation • 0.4B • Updated Jun 1 • 1.2k • 3

mlx-community/Qwen3.5-4B-MTP-4bit

Text Generation • 18.9M • Updated Jun 1 • 363 • 2

sakamakismile/Huihui-LFM2.5-8B-A1B-abliterated-MTP-NVFP4

Text Generation • 0.4B • Updated Jun 3 • 56 • 3

notSnix/Step-3.7-Flash-MTP-Draft-GGUF

3B • Updated Jun 3 • 584 • 5

ji-farthing/gemma-4-qat-q4_0-MTP-assistants-ik-llama-GGUF

0.4B • Updated Jun 8 • 337 • 5

patrickbdevaney/qwen-3.6-35b-a3b-dflash-jetson-agx-thor

Text Generation • Updated Jun 7 • 1

Janvitos/gemma-4-12B-it-qat-assistant-MTP-Q8_0-GGUF

0.4B • Updated Jun 6 • 2.87k • 37

Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance

Text Generation • 8B • Updated Jun 7 • 1.15k • 7

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed

Text Generation • 9B • Updated Jun 11 • 1.34k • 4

Youssofal/Qwen3.5-9B-MTPLX-Optimized-Speed-FP16

Text Generation • 9B • Updated Jun 7 • 360 • 2

nerkyor/Qwen3.6-35B-A3B-DSV4Pro-Thinking-Distill

Text Generation • 35B • Updated Jun 28 • 2.55k • 9

plunderstruck/Qwen3.6-27B-MTP-ROCmFP4-GGUF

0.5B • Updated Jun 21 • 1.31k • 31

SyzygyResearch/DeepSeek-V4-Flash-EAGLE3.1

Text Generation • Updated Jun 7 • 142 • 8

XiaomiMiMo/MiMo-V2.5-Pro-FP4-DFlash

Text Generation • 554B • Updated Jun 8 • 1.12k • 145

Pulsate1680/gemma-4-mtp-q8_0-gguf

Text Generation • 0.4B • Updated Jun 9 • 55 • 1

FINAL-Bench/Darwin-28B-Coder-GGUF

Text Generation • 27B • Updated 13 days ago • 973 • 34

hyperhuzaifa/Qwen3.6-27B-Uncensored-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated Jun 15 • 3.25k • 3

inference-optimization/Qwen3-8B-speculators.peagle-qwen3arch-ckpt4

2B • Updated Jun 16 • 24.1k • 1

modal-labs/Qwen3.6-35B-A3B-DFlash

Text Generation • 0.4B • Updated Jun 18 • 2.63k • 18

YTan2000/Qwen3.6-27B-MTP-TQ3_4S

Text Generation • 27B • Updated Jun 18 • 1.45k • 23

Jackrong/Qwopus3.6-27B-Coder-Compat-MTP-GGUF

Image-Text-to-Text • 0.5B • Updated 29 days ago • 186k • 133

s-batman/Ornith-1.0-9B-NVFP4-MTP-GGUF

Text Generation • 9B • Updated Jun 29 • 4.09k • 8

protoLabsAI/Ornith-1.0-9B-MTP-GGUF

Text Generation • 9B • Updated Jul 4 • 36.3k • 89

ji-farthing/MiMo-V2.5-Pro-DFlash-draft-ik-llama-GGUF

Text Generation • 3B • Updated 7 days ago • 491 • 3

mrexodia/Ornith-1.0-35B-AEON-Ultimate-Uncensored-MTP-GGUF

Text Generation • 36B • Updated Jun 28 • 7.17k • 8

poolside/Laguna-XS-2.1-DFlash-NVFP4

0.5B • Updated Jul 2 • 1.91k • 7

williamliao/gemma-4-12B-it-DFlash-GGUF

Text Generation • 0.7B • Updated 25 days ago • 1.77k • 3

williamliao/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated 25 days ago • 3.08k • 17