Mistral-Nemo-Gutenberg-Encore-12B finetuned on nbeerbower/human-writing-dpo with Mistral Instruct.
ORPO tuned with 1x RTX A6000 for 3 epochs.
Chat template
Files info
Base model