Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

9,286

Base only

Active filters: chat

Qwen/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.6B • Updated Sep 20, 2024 • 153k • 118

Qwen/Qwen2.5-3B-Instruct-GGUF

Text Generation • 3B • Updated Sep 20, 2024 • 176k • 158

Qwen/Qwen2.5-3B-Instruct

Text Generation • 3B • Updated Sep 25, 2024 • 5.27M • • 547

bartowski/Qwen2.5-14B-Instruct-GGUF

Text Generation • 15B • Updated Nov 8, 2024 • 71.7k • 70

lmstudio-community/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 26.4k • 26

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 51.3k • 69

mlx-community/Qwen2.5-0.5B-Instruct-4bit

Text Generation • 77.3M • Updated Sep 18, 2024 • 15.8k • 8

anthracite-org/magnum-v4-72b

Text Generation • 73B • Updated Nov 25, 2024 • 2.96k • • 59

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • 8B • Updated Nov 18, 2024 • 515k • 15

Kondara/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Sep 28, 2024 • 937 • 3

huihui-ai/Qwen2.5-Coder-7B-Instruct-abliterated

Text Generation • 8B • Updated Nov 25, 2024 • 2.25k • • 17

mradermacher/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

8B • Updated Aug 1, 2025 • 1k • 5

QuantFactory/Llama3.2-3B-Enigma-GGUF

Text Generation • 3B • Updated Oct 8, 2024 • 645 • 4

anthracite-org/magnum-v4-12b-gguf

Text Generation • 12B • Updated Nov 25, 2024 • 5.23k • 48

bartowski/LongWriter-glm4-9b-abliterated-GGUF

Text Generation • 9B • Updated Oct 19, 2024 • 1.84k • 4

NexaAI/Qwen2-Audio-7B-GGUF

Audio-Text-to-Text • 8B • Updated Nov 25, 2024 • 1.58k • 171

Qwen/Qwen2.5-Coder-0.5B-Instruct

Text Generation • 0.5B • Updated Nov 18, 2024 • 84.7k • • 76

Qwen/Qwen2.5-Coder-3B-Instruct

Text Generation • 3B • Updated Jan 12, 2025 • 112k • • 123

bartowski/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • 33B • Updated Nov 10, 2024 • 104k • 120

lmstudio-community/Qwen2.5-14B-Instruct-MLX-4bit

Text Generation • 2B • Updated Nov 13, 2024 • 2.75k • 3

bartowski/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated Nov 14, 2024 • 12.7k • 25

huihui-ai/Qwen2.5-0.5B-Instruct-abliterated

Text Generation • 0.5B • Updated Apr 28, 2025 • 511 • 2

DavidAU/L3.1-Instruct-Guru-8B-GGUF

Text Generation • 8B • Updated May 28, 2025 • 173 • 5

bartowski/QwQ-32B-Preview-abliterated-GGUF

Text Generation • 33B • Updated Dec 1, 2024 • 1.54k • 29

mradermacher/Hermes-3-Llama-3.2-3B-abliterated-GGUF

3B • Updated Mar 3, 2025 • 1.03k • 6

mradermacher/Llama-3.3-70B-Instruct-ablated-GGUF

71B • Updated Dec 21, 2024 • 5.53k • 1

bartowski/Llama-3.3-70B-Instruct-ablated-GGUF

Text Generation • 71B • Updated Dec 21, 2024 • 1.51k • 17

mradermacher/Qwen2.5-14B-Instruct-abliterated-v2-GGUF

15B • Updated Aug 1, 2025 • 5.01k • 10

bartowski/QVQ-72B-Preview-GGUF

Image-Text-to-Text • 73B • Updated Jan 8, 2025 • 714 • 55

mradermacher/Qwen2.5-32B-Instruct-abliterated-GGUF

33B • Updated Apr 29, 2025 • 3.76k • 3