mradermacher

/

model_requests

like 197

Closing as the model was taken down by @Naphula

The model is back up but you may encounter some early terminations due to the merge method (or one of the components) being unstable.

Just let me know what to do with that, should I quant? =)

Yes please do!

sure, I will queue when I can, cant do it right now

Just let me know what to do with that, should I quant? =)

You might as well since I have no more space for 24B merges right now. If it's too unstable then a v4 can replace it later.

In the instances where it did not terminate early, it produced very creative outputs, showing less non-compliance than its deleted della counterparts, and high diversity at low temps.

It's queued! =)

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Asmodeus-24B-v3-GGUF for quants to appear.