Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

75

Base only

Active filters: arm-optimized

Arm/deit-tiny-int8-xnnpack-executorch

Image Classification • Updated 11 days ago • 293

Arm/resnet-50-int8-xnnpack-executorch

Image Classification • Updated 11 days ago • 503

Arm/resnet-18-int8-xnnpack-executorch

Image Classification • Updated 11 days ago • 372

Arm/squeezenet-1-1-int8-xnnpack-executorch

Image Classification • Updated 10 days ago • 155

Arm/shufflenet-v2-x1-0-int8-xnnpack-executorch

Image Classification • Updated 11 days ago • 139

Arm/googlenet-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 10 days ago • 344

Arm/vit-base-int8-xnnpack-executorch

Image Classification • Updated 3 days ago • 1.38k

Arm/swin-tiny-int8-xnnpack-executorch

Image Classification • Updated 11 days ago • 472

Arm/inception-v3-int8-xnnpack-executorch-graviton-g4

Image Classification • Updated 11 days ago • 486

Arm/llama-3-2-1b-base-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 11 days ago • 28

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-vivo-x300

Text Generation • Updated 11 days ago • 31

Arm/yolov8s-int8-xnnpack-executorch

Object Detection • Updated 3 days ago • 51

Arm/whisper-tiny-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 11 days ago • 49

Arm/whisper-small-int8-xnnpack-executorch

Automatic Speech Recognition • Updated 10 days ago • 67

Arm/whisper-base-int8-litert

Automatic Speech Recognition • Updated 11 days ago • 36

Arm/whisper-medium-int8-litert

Automatic Speech Recognition • Updated 11 days ago • 16

Arm/whisper-large-v3-int8-litert

Automatic Speech Recognition • Updated 10 days ago • 20

Arm/efficient-sam-s-int8-xnnpack-executorch

Image Segmentation • Updated 11 days ago • 58

Arm/yolov8s-seg-int8-xnnpack-executorch

Image Segmentation • Updated 10 days ago • 59

Arm/yolov7-seg-int8-xnnpack-executorch

Image Segmentation • Updated 10 days ago • 62

Arm/mobile-sam-int8-xnnpack-executorch

Image Segmentation • Updated 10 days ago • 60

Arm/minilm-l6-v2-int8-litert

Feature Extraction • Updated 11 days ago • 11

Arm/bge-base-en-v1.5-int8-litert

Feature Extraction • Updated 11 days ago • 28

Arm/nomic-embed-text-v1-int8-litert

Feature Extraction • Updated 11 days ago • 12

Arm/mobilenet-v3-small-int8-xnnpack-executorch

Image Classification • Updated 10 days ago • 174

Arm/qwen3-0-6b-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 11 days ago • 59

Arm/llama-3-2-3b-instruct-onnx-genai-int4-kquantlast-emb-int8

Text Generation • Updated 11 days ago • 37

Arm/gemma-3-1b-base-onnx-genai-int4-emb-int8

Text Generation • Updated 11 days ago • 32

Arm/gemma-3-1b-instruct-onnx-genai-int4-emb-int8

Text Generation • Updated 11 days ago • 38

Arm/qwen2-5-1-5b-instruct-onnx-genai-int4-kquantlast-emb-int4

Text Generation • Updated 11 days ago • 40