Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

post-training-quantization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

98

Base only

Active filters: post-training-quantization

bg-digitalservices/Gemma-4-E2B-it-NVFP4

Text Generation • 4B • Updated Apr 6 • 4.58k • 2

jkim96/Nemotron-3-Ultra-550B-A55B-DASHQ-INT2-g32

Text Generation • 2B • Updated 7 days ago • 75 • 1

jkim96/Mistral-Medium-3.5-128B-DASHQ-INT2-g32

Image-Text-to-Text • 6B • Updated 7 days ago • 27 • 1

2imi9/gpt-oss-20B-NVFP4A16-BF16

Text Generation • 21B • Updated Dec 19, 2025 • 129 • 5

hassanshka/Biomni-R0-32B-PTQ-INT8

Text Generation • 33B • Updated Feb 13 • 4 • 1

bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4A16

Text Generation • 15B • Updated Apr 5 • 3.94k • 5

bg-digitalservices/Gemma-4-26B-A4B-it-NVFP4

Text Generation • 15B • Updated Apr 5 • 91.5k • 33

bg-digitalservices/Apertus-8B-2509-NVFP4

Text Generation • 5B • Updated Apr 6 • 5

bg-digitalservices/Apertus-8B-2509-NVFP4A16

Text Generation • 5B • Updated Apr 6 • 9

bg-digitalservices/Apertus-8B-Instruct-2509-NVFP4

Text Generation • 5B • Updated Apr 6 • 7 • 1

bg-digitalservices/Apertus-8B-Instruct-2509-NVFP4A16

Text Generation • 5B • Updated Apr 6 • 7

bg-digitalservices/Apertus-70B-2509-NVFP4

Text Generation • 36B • Updated Apr 6 • 68

bg-digitalservices/Apertus-70B-2509-NVFP4A16

Text Generation • 36B • Updated Apr 6 • 30

bg-digitalservices/Apertus-70B-Instruct-2509-NVFP4

Text Generation • 36B • Updated Apr 6 • 22 • 2

bg-digitalservices/Apertus-70B-Instruct-2509-NVFP4A16

Text Generation • 36B • Updated Apr 6 • 18 • 1

bg-digitalservices/Gemma-4-E2B-NVFP4

Text Generation • 4B • Updated Apr 6 • 342

bg-digitalservices/Gemma-4-E2B-NVFP4A16

Text Generation • 4B • Updated Apr 6 • 24

bg-digitalservices/Gemma-4-E2B-it-NVFP4A16

Text Generation • 4B • Updated Apr 6 • 20.6k

CyberFitz/gemma-4-26B-A4B-it-NVFP4

Image-Text-to-Text • 15B • Updated Apr 6 • 501 • 1

bg-digitalservices/Gemma-4-E4B-it-NVFP4

Text Generation • 6B • Updated Apr 6 • 124k

bg-digitalservices/Gemma-4-E4B-it-NVFP4A16

Text Generation • 6B • Updated Apr 6 • 4.36k

Entrit/tritllm-codec

Entrit/tritllm-paper

BitsPlease/HiSQRot4

Text-to-Video • Updated May 8

jkim96/Qwen3.6-27B-DASHQ-INT2-g32

Image-Text-to-Text • 3B • Updated 7 days ago • 102

jkim96/Qwen3.6-27B-DASHQ-INT3-g32

Image-Text-to-Text • 3B • Updated 7 days ago • 45

jkim96/Qwen3.6-27B-DASHQ-INT3-g64

Image-Text-to-Text • 3B • Updated 7 days ago • 51

jkim96/Qwen3.6-27B-DASHQ-INT4-g128

Image-Text-to-Text • 3B • Updated 7 days ago • 99

jkim96/Qwen3.6-27B-DASHQ-INT4-g32

Image-Text-to-Text • 3B • Updated 7 days ago • 54

jkim96/Qwen3.6-27B-DASHQ-INT4-g64

Image-Text-to-Text • 3B • Updated 7 days ago • 47