exlama quant
#1
by
Skorcht - opened
can you upload an exlama quant? thnaks
A friend of mine is quanting the model, 6bpw is up and others are being worked on.
https://huggingface.co/lucyknada/cgato_Nemo-12b-Humanize-KTO-v0.1-exl2
cgato changed discussion status to
closed