Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

436

Base only

Active filters: compression

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-squadv1-v2

Updated Jul 31, 2022 • 5

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-mnli-v2

Updated Jul 31, 2022 • 3

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-mnli-v2

Updated Jul 31, 2022 • 6

RedHatAI/oBERT-12-upstream-pruned-unstructured-90-finetuned-qqp-v2

Updated Jul 31, 2022 • 7

RedHatAI/oBERT-12-upstream-pruned-unstructured-97-finetuned-qqp-v2

Updated Jul 31, 2022 • 7

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • 6B • Updated Jan 10, 2025 • 13 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • 6B • Updated Dec 25, 2024 • 10 • 5

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 19

RedHatAI/sst2-distilbert-sparse-blog

Text Classification • Updated Mar 13, 2024 • 8 • 4

aoxo/kevin-token-compressor

Text Generation • Updated Sep 18, 2024 • 12

justuswill/UQDM

Updated Jun 18, 2025

kalsy/TEZip

Updated Jun 24, 2025

prompterminal/nanogpt-shakespeare-compressed

Text Generation • Updated Jul 21, 2025 • 7

prompterminal/nanogpt-enwik8-compressed

Text Generation • Updated Jul 21, 2025 • 3

prompterminal/nanogpt-enwik8-compressed-working

Text Generation • Updated Jul 21, 2025 • 6 • 1

haichaozhang/VQ-Token-llava-ov-0.5b

Video-Text-to-Text • 1B • Updated Sep 21, 2025 • 11 • 2

qep/qep-1bit-extreme

Text Generation • 23B • Updated Sep 8, 2025 • 12 • 15

swayamsingal/tencent-Hunyuan-MT-7B-light-nanoquant-light

8B • Updated Sep 3, 2025 • 2 • 1

swayamsingal/tencent-Hunyuan-MT-7B-medium-nanoquant-medium

8B • Updated Sep 3, 2025 • 4

kyne0127/Qwen3-30B-A3B-TopK4-Compressed

Text Generation • 31B • Updated Sep 22, 2025 • 7

mradermacher/Qwen3-30B-A3B-TopK4-Compressed-GGUF

31B • Updated Sep 28, 2025 • 167

mradermacher/Qwen3-30B-A3B-TopK4-Compressed-i1-GGUF

31B • Updated Dec 8, 2025 • 631

ggunio/B2NL-v6.1.2

Updated Sep 26, 2025 • 6

ggunio/B2NL-IntelligentTokenizer-v6.2.1

0.2B • Updated Oct 7, 2025 • 17

cerebras/Qwen3-Coder-REAP-363B-A35B-FP8

Text Generation • 363B • Updated Oct 14, 2025 • 22 • 16

cerebras/Qwen3-Coder-REAP-246B-A35B-FP8

Text Generation • 246B • Updated Oct 14, 2025 • 16 • 22

huawei-csl/Qwen3-1.7B-3bit-SINQ

Text Generation • 0.5B • Updated Feb 2 • 11 • 7

huawei-csl/Qwen3-1.7B-3bit-ASINQ

Text Generation • 0.5B • Updated Feb 2 • 9 • 7

huawei-csl/Qwen3-14B-3bit-SINQ

Text Generation • 3B • Updated Feb 2 • 17 • 5

huawei-csl/Qwen3-14B-3bit-ASINQ

Text Generation • 3B • Updated Feb 2 • 7 • 5