量化相关
#6
by Paulzhou - opened
合影，官方会出int4量化么？更推荐AWQ还是GPTQ
it has already been trained with QAT so you can just pick a community quantized Q4 version.
合影，官方会出int4量化么？更推荐AWQ还是GPTQ
it has already been trained with QAT so you can just pick a community quantized Q4 version.