Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42

Base only

Active filters: iq2_xxs

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 16 days ago • 337k • 157

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 4 days ago • 1.58M • 455

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Headroom128

Text Generation • 284B • Updated 18 days ago • 85.6k • 32

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 322k • 128

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Quality128

Text Generation • 284B • Updated 15 days ago • 20.7k • 6

mrtib/DeepSeek-V4-Flash-0731-IQ2XXS

Text Generation • Updated 16 days ago • 1

SpeederX/DeepSeek-V4-Flash-0731-IQ2XXS-Q2K-EM-GGUF

Text Generation • 85B • Updated 8 days ago • 147 • 1

Baekpica/Motif-3-Mixed-Quant-GGUF

Text Generation • 315B • Updated 2 days ago • 1.97k • 1

Unkto/DeepSeek-V4-Flash-0731-DSpark-Drafter-IQ1M-IQ2XXS-GGUF

20B • Updated 2 days ago • 990 • 1

Baekpica/dots3-note-prev-Mixed-Quant-GGUF

Text Generation • 281B • Updated 1 day ago • 684 • 1

CoreWolf/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated about 11 hours ago • 19 • 1

bleysg/DeepSeek-V4-Flash-IQ2XXS-Q2K-FP8-120GB-target

Text Generation • 84B • Updated May 11 • 268 • 6

opensota/deepseek-v4-gguf

Text Generation • 284B • Updated May 12 • 234 • 2

jedisct1/DeepSeek-V4-Flash-imatrix-aligned

Text Generation • 284B • Updated May 13 • 324 • 5

dusterbloom/SR2AM-v1.0-30B-IQ2XXS-asym-GGUF

Text Generation • 31B • Updated May 24 • 2.28k

zenlm/zen5-pro-gguf

Text Generation • 284B • Updated Jul 14 • 243 • 1

zenlm/zen5-max-gguf

Text Generation • 1.6T • Updated Jul 14 • 289 • 1

Keepser/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated May 31 • 163 • 1

rbinrs/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 14 • 259 • 2

kavenmartinez/Qwen3.6-27B-IQ2_XXS-webgpu-GGUF

Text Generation • 27B • Updated Jun 15 • 52

nahid37/deepseek-v4-gguf

Text Generation • 284B • Updated Jun 22 • 67

Ninnix96/Qwen3.6-35B-A3B-gguf

Text Generation • 35B • Updated 17 days ago • 1.15k • 2

eadx/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 5 • 146

wangyanwei123/deepseek-v4-gguf

Text Generation • 284B • Updated Jul 7 • 68

windy88/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jul 8 • 150

andreaborio/DeepSeek-V4-Flash-Hebrus-GGUF

Text Generation • Updated 4 days ago • 2.36k • 2

ox-ox/DeepSeek-V4-Flash-0731-gguf-ds4

Text Generation • 284B • Updated 18 days ago • 9.28k • 24

schlaflos/DeepSeek-V4-Flash-0731-antirez-ds4-GGUF

Text Generation • 20B • Updated 19 days ago • 7.34k • 10

apetersson/DeepSeek-V4-Flash-0731-DS4-Quality128

Text Generation • 284B • Updated 15 days ago • 1.92k • 4

Ninnix96/KAT-Coder-V2.5-Dev-gguf

Text Generation • 35B • Updated 17 days ago • 734