ST settings ?

#1
by edreces - opened

what sampler settings should i use with this model ? also what context template + instruct template that work the best ? i tried several it keeps botching the messages/responses.

I've used a few templates based on Mistral-v7 Tekken,one was "T4" I think. Worth taking a look at, IMO

Sign up or log in to comment