rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8 Text Generation • Updated 6 days ago • 14
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8 Text Generation • Updated 6 days ago • 18
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 22 days ago • 11
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 22 days ago • 16
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8 Text Generation • Updated 22 days ago • 14
rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 22 days ago • 20
rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 22 days ago • 29
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8 Text Generation • Updated 22 days ago • 18
rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8 Text Generation • Updated Feb 8 • 9
rungalileo/xlm-roberta-base-misogyny-sexism-tweets-quantized-traced Text Classification • Updated Dec 14, 2023 • 14