The model has severe grammar issues

#4
by BigBeavis - opened

I'm using Q6 quant by mradermacher. It's doing stuff like '``t, etc instead of 's. I suspect this is because of the abliterated model in the merge, because i had the same issue in a different abliterated version, but not in default gemma 3 even at a lower quant.

It's doing stuff like '``t, etc instead of 's.

Hello.
Please explain about grammar, it would be great if you provide a screenshot with error.
I'm using IQ4_XS and IQ3_XL and never encountered bad grammar on EN. (Though it is possible that i overlook some minor errors since i'm not native speaker.) It could be a preset/syspromt issue. For gemma3 I use sleepdeprived3/Gemma3-T4 preset ( https://huggingface.co/sleepdeprived3/Gemma3-T4 ), with shingane v.1 syprompt (https://huggingface.co/CrucibleLab/L3.3-Dark-Ages-70b-v0.1/blob/main/sysprompts/Shingane.json).

Sign up or log in to comment