Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

46

Base only

Active filters: low-rank

nozomuteruyo14/Diff_LoRA

Text Classification • Updated Feb 12, 2025

prompterminal/nanogpt-shakespeare-compressed

Text Generation • Updated Jul 21, 2025 • 5

prompterminal/nanogpt-enwik8-compressed

Text Generation • Updated Jul 21, 2025 • 5

jackal79/gpt2-ibce-lowrank-192

Text Generation • Updated Sep 19, 2025 • 6

codemichaeld/sdxl_clip_g_fp8

Updated Dec 1, 2025 • 82 • 1

codemichaeld/wan2.1_vae_fp8_l01

Updated Dec 1, 2025 • 81

codemichaeld/sdxl_clip-l_fp8_l01

Updated Dec 1, 2025 • 25

AEON-7/Gemma-4-31B-it-DECKARD-HERETIC-Uncensored-NVFP4-SVDQuant

Text Generation • 19B • Updated 24 days ago • 339 • 2

mesklintech/mesko-tts

Text-to-Speech • Updated May 22 • 6 • 2

tjarvis91/qovaryx-50m-scratch-base

Text Generation • Updated Jun 5 • 17

tjarvis91/qovaryx-350m-scratch-base

Text Generation • Updated Jun 5 • 14 • 1

tjarvis91/qovaryx-1b-scratch-base

Text Generation • Updated Jun 5 • 15

MoritzMo123/kfac-svd_uniform_llama-3-8b_0.7

Text Generation • 6B • Updated Jun 2 • 12

MoritzMo123/kfac-svd_lems_mistral-7b_0.9

Text Generation • 7B • Updated Jun 2 • 6

MoritzMo123/kfac-svd_lems_llama-3-8b_0.8

Text Generation • 7B • Updated Jun 2 • 8

MoritzMo123/kfac-svd_lems_Qwen3-8B_0.9

Text Generation • 7B • Updated Jun 2 • 6

MoritzMo123/kfac-svd_uniform_llama-3-8b_0.8

Text Generation • 7B • Updated Jun 2 • 15

MoritzMo123/kfac-svd_lems_mistral-7b_0.8

Text Generation • 6B • Updated Jun 2 • 8

MoritzMo123/kfac-svd_uniform_Qwen3-8B_0.7

Text Generation • 6B • Updated Jun 2 • 6

MoritzMo123/kfac-svd_lems_llama-3-8b_0.7

Text Generation • 6B • Updated Jun 2 • 7

MoritzMo123/kfac-svd_lems_llama-3-8b_0.9

Text Generation • 7B • Updated Jun 2 • 7

MoritzMo123/kfac-svd_lems_mistral-7b_0.6

Text Generation • 4B • Updated Jun 2 • 7

MoritzMo123/kfac-svd_lems_mistral-7b_0.7

Text Generation • 5B • Updated Jun 2 • 8

MoritzMo123/kfac-svd_uniform_mistral-7b_0.8

Text Generation • 6B • Updated Jun 2 • 7

MoritzMo123/kfac-svd_uniform_Qwen3-8B_0.6

Text Generation • 5B • Updated Jun 2 • 9

MoritzMo123/kfac-svd_uniform_mistral-7b_0.9

Text Generation • 7B • Updated Jun 2 • 5

MoritzMo123/kfac-svd_lems_llama-3-8b_0.6

Text Generation • 5B • Updated Jun 2 • 5

MoritzMo123/kfac-svd_uniform_mistral-7b_0.6

Text Generation • 4B • Updated Jun 2 • 7

MoritzMo123/kfac-svd_uniform_llama-3-8b_0.9

Text Generation • 7B • Updated Jun 2 • 7

MoritzMo123/kfac-svd_lems_Qwen3-8B_0.6

Text Generation • 5B • Updated Jun 2 • 65