Article
Uncensor any LLM with abliteration
mlabonne
• • 899ManniX PRO
ManniX-ITA
AI & ML interests
None yet
Recent Activity
posted an update 1 day ago
🚀 Qwen3.6-27B-A3B-CoderX — the long-horizon sibling to A3B-Coder. Same 256→184 expert budget (~35B→27B, A3B active), different selection: our saliency map picks the keep-set, a REAP-style per-layer floor (p=24) protects the tail, and the 72 evicted experts per layer are folded DERN-style into the survivors instead of discarded. No fine-tuning, no distillation.
📊 Q6_K + imatrix, llama.cpp b9700, greedy, one pinned geometry per bench, same host — CoderX / A3B-Coder / unpruned 256e:
⚡ LiveCodeBench v6 (77q, 24k think) — 72.73 / 61.04 / 61.04 → +11.7pp over both
✅ HumanEval+ (164) — 96.95 / 95.12 / 93.90 → best of the three
🤝 MultiPL-E-100 (rs+java+js) — 88.67 / 89.00 / 91.00
⚠️ Read that last row honestly: a same-basis repeat of MultiPL-E moved 1.0pp on batch-scheduling nondeterminism alone. The 0.33pp CoderX↔Coder gap is INSIDE that band — a tie. The 2.33pp gap to the base is outside it and real. CoderX takes Rust (0.85 vs 0.81), gives up JS (0.92 vs 0.96).
🎯 Ships top-8, and that was measured, not assumed: MBPP-full 78.4 / 79.0 at top-8 vs 73.2 / 73.0 at top-10. Opposite call from A3B-Coder, which bakes top-10.
🧠 It thinks long — LCB median completion ~15.8k tokens vs ~2.2k for Coder. The length is where the win comes from; give it context headroom rather than clamping it.
🔬 Not measured yet: the canonical 9-bench. GPQA / MATH-500 / IFEval are deliberately NOT quoted — treat the non-code profile as unknown. Coder remains the one with a published 9-bench table.
📦 bf16 safetensors (text-only) · 19 GGUF tiers, EVERY K/I-quant imatrix-built and verified by reading quantize.imatrix.* back out of each uploaded file · Ollama 39 tags (19 text + 19 vision-<tier> + :latest). MTP in every tier — draft_num_predict 3 gives 190→252 tok/s (+33%) on an RTX 5080.
🔗 https://huggingface.co/ManniX-ITA/Qwen3.6-27B-A3B-CoderX
🔗 https://huggingface.co/ManniX-ITA/Qwen3.6-27B-A3B-CoderX-MTP-GGUF
🔗 https://ollama.com/mannix/qwen3.6-27b-a3b-coderx updated a collection 1 day ago
Qwen-3.6 updated a collection 1 day ago
Qwen-3.6Organizations
None yet
upvoted 2
articles about 2 years ago
Article
LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)
wolfram
• • 64 upvoted a collection over 2 years ago
upvoted 2
articles over 2 years ago
Article
Fine-tune Llama 3 with ORPO
mlabonne
• • 238 Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
- +3
ybelkada, timdettmers, artidoro, sgugger, smangrul
• • 180