OpenYourMind-Qwen3.6-35B-A3B-kuato-DPO-abliterated-uncensored

I do this work independently and release it for free. Donations are welcome and go toward compute for more and larger abliterations.

Bitcoin: bc1qsvfduzj9fjs9fugpc52yver3f2g8fp7xjxecdv

Community discussion: https://discord.gg/rhUZY5GEZr

Overview

This is an abliterated and DPO-retrained version of Qwen/Qwen3.6-35B-A3B.

The model was first modified through refusal ablation, then retrained with a private DPO dataset of fewer than 1000 samples to fix the remaining hedging behavior after ablation. In testing, this version reached 0 refusals on HarmBench and showed 0 hedging compared to the other ablated models tested.

After ablation and DPO, the original Qwen3.6 vision layers were readded to retain the multimodal functionality of the base model. This repository contains the repaired FP16 safetensors build with the visual tower present.

Model Details

Attribute Value
Base model Qwen/Qwen3.6-35B-A3B
Method Refusal ablation plus DPO retraining
DPO data Private dataset, fewer than 1000 samples
Format FP16 safetensors
Architecture Qwen3.6 MoE vision-language model
Vision support Readded after ablation and DPO
HarmBench result 0 refusals in local testing

Files

File Description
model-00001-of-00002.safetensors FP16 language-model shard
model-00002-of-00002.safetensors FP16 language-model shard
model-visual-original.safetensors Readded original Qwen3.6 visual tower and merger tensors
model.safetensors.index.json Safetensors shard index including the vision tensors
chat_template.jinja Vision/tool-calling chat template
config.json Model config
preprocessor_config.json Image processor config
video_preprocessor_config.json Video processor config
tokenizer.json, tokenizer_config.json Tokenizer files

GGUF quantizations are published separately:

https://huggingface.co/OpenYourMind/OpenYourMind-Qwen3.6-35B-A3B-kuato-DPO-abliterated-uncensored-GGUF

Transformers

from transformers import AutoModelForImageTextToText, AutoProcessor

repo = "OpenYourMind/OpenYourMind-Qwen3.6-35B-A3B-kuato-DPO-abliterated-uncensored"

processor = AutoProcessor.from_pretrained(repo, trust_remote_code=True)
model = AutoModelForImageTextToText.from_pretrained(
    repo,
    torch_dtype="auto",
    device_map="auto",
    trust_remote_code=True,
)

Notes

The DPO dataset is private. The intent of this release is to share the resulting model, not the training data.

Use is the responsibility of the user. Make sure your usage complies with applicable laws, platform rules, and deployment requirements.

Downloads last month
1,332
Safetensors
Model size
36B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for OpenYourMind/OpenYourMind-Qwen3.6-35B-A3B-kuato-DPO-abliterated-uncensored

Finetuned
(109)
this model
Quantizations
5 models