plawanrath/phi-3.5-mini-instruct-q3-mlx-cba
Text Generation • 0.5B • Updated • 244
Quantization Undoes Alignment — IEEE Cloud Summit 2026
MLX artifacts for the IEEE Cloud Summit 2026 paper. 3 LLMs × 5 precisions (BF16/Q8/Q6/Q4/Q3, gs=64).
-
-
plawanrath/phi-3.5-mini-instruct-q4-mlx-cba
Text Generation • 0.6B • Updated • 173 -
plawanrath/phi-3.5-mini-instruct-q6-mlx-cba
Text Generation • 0.8B • Updated • 63 -
plawanrath/mistral-7b-instruct-v0.3-q3-mlx-cba
Text Generation • 0.9B • Updated • 198 -
plawanrath/qwen2.5-7b-instruct-q3-mlx-cba
Text Generation • 1.0B • Updated • 77 -
plawanrath/mistral-7b-instruct-v0.3-q4-mlx-cba
Text Generation • 1B • Updated • 152 -
plawanrath/phi-3.5-mini-instruct-q8-mlx-cba
Text Generation • 1B • Updated • 86 -
plawanrath/qwen2.5-7b-instruct-q4-mlx-cba
Text Generation • 1B • Updated • 65 -
plawanrath/mistral-7b-instruct-v0.3-q6-mlx-cba
Text Generation • 7B • Updated • 161 -
plawanrath/qwen2.5-7b-instruct-q6-mlx-cba
Text Generation • 8B • Updated • 48 -
plawanrath/phi-3.5-mini-instruct-bf16-mlx-cba
Text Generation • 4B • Updated • 151 -
plawanrath/mistral-7b-instruct-v0.3-q8-mlx-cba
Text Generation • 7B • Updated • 258 -
plawanrath/qwen2.5-7b-instruct-q8-mlx-cba
Text Generation • 8B • Updated • 62 -
plawanrath/mistral-7b-instruct-v0.3-bf16-mlx-cba
Text Generation • 7B • Updated • 320 -
plawanrath/qwen2.5-7b-instruct-bf16-mlx-cba
Text Generation • 8B • Updated • 36