any news about the gguf models?
#5
by IbnAbdeen - opened
3.0 gguf model is a great model, can't wait for the 3.1 gguf model
I will make the gguf versions soon
Waiting for GGUFs Q4KS, Q6K
still waiting.
sorry, have been really busy. will release a better version in a week with all quants
waiting and waiting
Hi @IbnAbdeen @Alastar-Smith @ryg81 @ddongxxingg gguf has been created at https://huggingface.co/shuttleai/shuttle-3.1-aesthetic/tree/main/gguf
There is going to be a new model very soon with the GGUFs this time, thanks for your patience's <3
@xtristan ,text_encoder_2 has a total of more than 9G. Can you provide GGUF format to reduce the memory size? I am a student and my computer is not very ideal.
When the next release coming?