How did you generate the 8-bit model?
#3
by zaptrem - opened
I see documentation for using and fine-tuning the 8-bit model in the card, but not the code that was used to actually generate the 8-bit version. Can you share that?
Thanks!
Same question.
Can can we take an arbitrary from the HF Hub and generate an 8-bit version?
Same question.
Can can we take an arbitrary from the HF Hub and generate an 8-bit version?
Looks like you can now with this: https://huggingface.co/blog/hf-bitsandbytes-integration
zaptrem changed discussion status to closed