Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42

Base only

Active filters: Optimum-Intel

Echo9Zulu/LFM2.5-8B-A1B-int4_sym-awq-ov

Updated 8 days ago • 48 • 1

Echo9Zulu/Cydonia-24B-v2.1-int4_asym-awq-wqe-se-ov

Text Generation • Updated Mar 28, 2025 • 3

Echo9Zulu/gemma-3-4b-it-int8_asym-ov

Image-Text-to-Text • Updated Apr 13, 2025 • 12 • 1

Echo9Zulu/gemma-3-12b-it-int4_asym-ov

Image-Text-to-Text • Updated Apr 12, 2025 • 8 • 1

Echo9Zulu/gemma-3-12b-it-int8_asym-ov

Image-Text-to-Text • Updated Apr 12, 2025 • 3 • 1

Echo9Zulu/gemma-3-4b-it-qat-int4_asym-ov

Image-Text-to-Text • Updated Apr 18, 2025 • 14 • 3

Echo9Zulu/Qwen3-1.7B-int8_asym-ov

Text Generation • Updated Apr 30, 2025 • 43

Echo9Zulu/Qwen3-0.6B-fp16-ov

Text Generation • Updated Apr 30, 2025 • 4

Echo9Zulu/Qwen3-30B-A3B-int4_asym-hia-awq-gptq-se-ov

Updated May 8, 2025 • 5 • 1

Echo9Zulu/Phi-4-mini-instruct-OpenVINO

Text Generation • Updated May 20, 2025 • 1

Echo9Zulu/gemma-3-4b-it-OpenVINO

Image-Text-to-Text • Updated May 20, 2025

Echo9Zulu/gemma-3-12b-it-OpenVINO

Image-Text-to-Text • Updated May 20, 2025 • 1

Echo9Zulu/DeepSeek-R1-0528-Qwen3-8B-OpenVINO

Text Generation • Updated May 29, 2025 • 4

Echo9Zulu/Hermes-4-70B-int4_asym-ov

Text Generation • Updated Aug 26, 2025 • 6

Echo9Zulu/Hermes-4-70B-int4_asym-awq-ov

Text Generation • Updated Aug 29, 2025 • 16

Echo9Zulu/Magistral-Small-2509-Text-Only-int4_asym-awq-ov

Updated Oct 3, 2025 • 6

Echo9Zulu/Qwen3-4B-Instruct-2507-int4_asym-awq-ov

Updated Oct 3, 2025 • 26

Echo9Zulu/Dolphin-X1-8B-int4_asym-awq-ov

Text Generation • Updated Oct 14, 2025 • 5

Gapeleon/Satyr-V0.1-4B-HF-int4_awq-ov

Updated Oct 15, 2025 • 3 • 2

Echo9Zulu/Nanonets-OCR2-3B-LM-INT4_ASYM-VE-FP16-ov

Updated Oct 17, 2025 • 2 • 1

Echo9Zulu/Impish_Nemo_12B-int4_asym-awq-ov

Updated Oct 19, 2025 • 3

Echo9Zulu/Qwen2.5-Microsoft-NextCoder-Soar-Instruct-FUSED-CODER-Fast-11B-int4_asym-awq-ov

Updated Oct 24, 2025 • 3

Echo9Zulu/Cydonia-24B-v4.2.0-int4_asym-awq-ov

Updated Oct 24, 2025 • 3 • 1

Echo9Zulu/Muse-12B-int4_asym-ov

Updated Nov 8, 2025

Echo9Zulu/gpt-oss-7.2b-specialized-science-pruned-moe-only-9-experts-int4_asym-ov

Updated Jan 4 • 2 • 1

Echo9Zulu/Nemotron-Cascade-14B-Thinking-int4_asym-se-ov

Updated Feb 8 • 2

Echo9Zulu/Qwen3-VL-4B-Instruct-int4_asym-ov

Image-Text-to-Text • Updated Apr 12 • 8

Echo9Zulu/Anubis-Mini-8B-v1-int4_asym-ov

Text Generation • Updated Apr 17 • 4

Echo9Zulu/Gemma4-Biomedical-E4B-int4_asym-ov

Updated May 6 • 6

droans/qwen3.6-27B-int4-asym-ov

Image-Text-to-Text • Updated May 6 • 68 • 3