We performed a 20% REAP on the base model this is preparation for CPT and SFT/DPO. Further releases will be under IRIS 18B.

Benchmark Score Notes
ARC-Easy 79.59% acc_norm
ARC-Challenge 50.60% acc_norm
HellaSwag 70.50% acc_norm
Winogrande 67.17% acc
GSM8K 79.00% exact_match (flexible-extract)
MMLU 65.82% acc (average across all subjects)
Downloads last month
26
Safetensors
Model size
18B params
Tensor type
F32
ยท
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for jerrimu/ERNIE-21B-REAP

Finetuned
(2)
this model
Finetunes
1 model
Quantizations
1 model