Uncensoring Request
#1
by Redvodk - opened
Could you uncensor Zyphra ZAYA1 8B?
This one is quite the challenger. It is taking roughly 12hrs to process and does not seem to budge with both ARA and SOM. Only attn layers load as MLP layers are 3D shaped and Heretic is designed around 2D tensors. At least that's why I think it won't process MLP's. Still, ablating only attn layers should be enough to eliminate a baseline of refusals, if not all, in most models. This one does not see any reduction in refusals even at high KLD situations throughout my varied short attempts. Notably, it says, "I am sorry that you are asking this question..." to most prompts or returns an empty response.
Thank you so much,
Good luck with all that